A resource effective approach for distributed machine learning over a local network

Authors/Creators

Aarish Iyer
Haramrit Singh Khurana
Ivan Maria
Amiya Kumar Tripathy, Edith Cowan UniversityFollow

Abstract

Areas of computer science such as data science and machine learning have boomed in recent years due to the increase in the availability of data. This has led to a need in the upsurge of computational power of various systems to handle large datasets consisting of images, text, audios, etc. However, training a machine learning model on a single node system can prove to be a tedious as well as time consuming task. One of the solutions to this problem is distributing the model training process. Some of the current solutions that allow distributed machine learning are limited to multiple GPUs on a single node. This work attempts to propose a system which aims to solve this problem by providing a platform that allows distributing the machine learning process over a local network (using locally available nodes). This will ensure the effective use of all the resources available. © 2019 IEEE.

Document Type

Conference Proceeding

Date of Publication

1-1-2019

School

School of Science

Copyright

subscription content

Publisher

Institute of Electrical and Electronics Engineers Inc.

Comments

Iyer, A., Khurana, H. S., Maria, I., & Tripathy, A. K. (2019, December). A resource effective approach for distributed machine learning over a local network. In 2019 International Conference on Advances in Computing, Communication and Control (ICAC3). IEEE. https://doi.org/10.1109/ICAC347590.2019.9036818

Recommended Citation

Iyer, A., Khurana, H. S., Maria, I., & Tripathy, A. K. (2019). A resource effective approach for distributed machine learning over a local network. DOI: https://doi.org/10.1109/ICAC347590.2019.9036818