DiscoverThe Data Exchange with Ben LoricaThe combination of the right software and commodity hardware will prove capable of handling most machine learning tasks
The combination of the right software and commodity hardware will prove capable of handling most machine learning tasks

The combination of the right software and commodity hardware will prove capable of handling most machine learning tasks

Update: 2020-01-09
Share

Description

In this episode of the Data Exchange I speak with Nir Shavit, Professor of EECS at MIT, and cofounder and CEO of Neural Magic, a startup that is creating software to enable deep neural networks to run on commodity CPUs (at GPU speeds or faster). Their initial products are focused on model inference, but they are also working on similar software for model training.

Our conversation spanned many topics, including:

  • Neurobiology, in particular the combination of Nir’s research areas of multicore software and connectomics – a branch of neurobiology.
  • Why he believes the combination of the right software and CPUs will prove capable of handling many deep learning tasks.
  • Speed is not the only factor: the “unlimited memory” of CPUs are able to unlock larger problems and architectures.
  • Neural Magic’s initial offering is in inference, model training using CPUs is also on the horizon.

Detailed show notes can be found on The Data Exchange web site.

Comments 
loading
In Channel
loading
00:00
00:00
1.0x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

The combination of the right software and commodity hardware will prove capable of handling most machine learning tasks

The combination of the right software and commodity hardware will prove capable of handling most machine learning tasks

Ben Lorica