DiscoverSoftware Engineering Daily
Software Engineering Daily
Claim Ownership

Software Engineering Daily

Author: Software Engineering Daily

Subscribed: 41,602Played: 986,058
Share

Description

Technical interviews about software topics.
830 Episodes
Reverse
Logs are the source of truth. If a company is sufficiently instrumented, the logging data that streams off of the internal infrastructure can be refined to tell a comprehensive story for what is changing across that infrastructure in real time. This includes logins, permissions changes, other events that could signal a potential security compromise. Datadog The post Security Monitoring with Marc Tremsal appeared first on Software Engineering Daily.
Dev.to has become one of the most popular places for developers to write about engineering, programming languages, and everyday life. For those who have not seen it, DEV is like a cross between Twitter and Medium, but targeted at developers. The content on DEV ranges from serious to humorous to technically useful. DEV contains a The post DEV and Forem with Ben Halpern appeared first on Software Engineering Daily.
Drug trials can lead to new therapeutics and preventative medications being discovered and placed on the market. Unfortunately, these drug trials typically require animal testing. This means animals are killed or harmed as a result of needing to verify that a drug will not kill humans. Animal testing is unavoidable, but the extent to which The post Drug Simulations with Bryan Vicknair and Jason Walsh appeared first on Software Engineering Daily.
Across a company, there is a wide range of resources that employees need access to. Documents, S3 buckets, git repositories, and many others. As access to resources changes across the organization, a history of the changes to permissions can be useful for compliance and monitoring. Indent is a system for simplifying access management across infrastructure. The post Access Control Management with Fouad Matin and Dan Gillespie appeared first on Software Engineering Daily.
Acquisitions are part of the technology industry. A successful corporation will often have an “exit”, either going public or becoming acquired. And with each of these corporations, there is a set of stories that narrate the company from beginning to end.  Acquired is a podcast that tells the stories of companies such as YouTube, Instagram, The post Acquired Podcasting with David Rosenthal and Ben Gilbert appeared first on Software Engineering Daily.
Ray is a general purpose distributed computing framework. At a low level, Ray provides fault-tolerant primitives that support applications running across multiple processors. At a higher level, Ray supports scalable reinforcement learning, including the common problem of hyperparameter tuning. In a previous episode, we explored the primitives of Ray as well as Anyscale, the business The post Ray Applications with Richard Liaw appeared first on Software Engineering Daily.
Pandas is a Python data analysis library, and an essential tool in data science. Pandas allows users to load large quantities of data into a data structure called a dataframe, over which the user can call mathematical operations. When the data fits entirely into memory this works well, but sometimes there is too much data The post Modin: Pandas Scalability with Devin Petersohn appeared first on Software Engineering Daily.
A large codebase cannot be searched with naive indexing algorithms. In order to search through a codebase the size of Uber’s it is necessary to build a much more sophisticated indexing system than simple pure text search. Sourcegraph is a system for universal code search. It allows developers to more easily onboard to a new The post Sourcegraph: Code Search and Intelligence with Beyang Liu appeared first on Software Engineering Daily.
Users do not use web applications in the way that you might expect. And it is not easy to get the data that is necessary to get a full picture. But a newer API within browsers does make this more possible by capturing DOM mutations.  The change capture of these DOM mutations can be stored The post Digital Experience Analytics with Michael Morrissey appeared first on Software Engineering Daily.
Managing microservices becomes a challenge as the number of services within the organization grows. With that many services comes more interdependencies–downstream and upstream services that may be impacted by an update to your service.  One solution to this problem: a dashboard and newsfeed system that lets you see into the health and changes across your The post Cortex: Microservices Management with Anish Dhar and Ganesh Datta appeared first on Software Engineering Daily.
ADP has been around for more than 70 years, fulfilling payroll and other human resources services. Payroll processing is a complex business, involving the movement of money in accordance with regulatory and legal strictures.  From an engineering point of view, ADP has decades of software behind it, and a bright future of a platform company The post ADP Engineering with Tim Halbur appeared first on Software Engineering Daily.
Software companies can be funded in a variety of ways: venture capital, self-funding, and debt, among others. In order to receive financing, a company is evaluated on its ability to generate future cash flows. After all, a valuation is a number that summarizes the present value of future cash flows. Determining that valuation number is The post Capital Allocation with Blair Silverberg and Chris Olivares appeared first on Software Engineering Daily.
GitHub has been a social network for developers for many years. Most social networks are centered around mobile applications, but GitHub sits squarely in a developer’s browser-based desktop workflow. As a result, the design of a mobile app for GitHub is less straightforward. GitHub did acquire a popular mobile client called GitHawk, which was developed The post GitHub Mobile with Brian Lovin and Ryan Nystrom appeared first on Software Engineering Daily.
A service mesh provides routing, load balancing, policy management, and other features to a set of services that need to communicate with each other. The mesh can simplify operations across these different services by providing an interface to configure them.  There are lots of different vendors who offer service mesh technology: AWS has AppMesh, Google The post Multimesh with Luke Kysow appeared first on Software Engineering Daily.
Netflix runs all of its infrastructure on Amazon Web Services. This includes business logic, data infrastructure, and machine learning. By tightly coupling itself to AWS, Netflix has been able to move faster and have strong defaults about engineering decisions. And today, AWS has such an expanse of services that it can be used as a The post Metaflow: Netflix Machine Learning Platform with Savin Goyal appeared first on Software Engineering Daily.
WordPress has been a dominant force in the world of online publishing for many years because of how battle-tested it is. WordPress is the definitive leader in CMS technology. But there have always been alternatives.  Drupal, Ghost, and other open source CMSes. More recently, there has been an emergence of the headless CMS, such as The post Strapi: Headless CMS with Pierre Burgy appeared first on Software Engineering Daily.
M3 is a scalable metrics database originally built to host Uber’s rapidly growing data storage from Prometheus. When Rob Skillington was at Uber, he helped design, implement, and deploy M3. Since leaving Uber, he has co-founded a company around a hosted version of M3 called Chronosphere. If you have access to a scalable metrics database, The post Chronosphere: Scalable Metrics Database with Rob Skillington appeared first on Software Engineering Daily.
Developing machine learning models is not easy. From the perspective of the machine learning researcher, there is the iterative process of tuning hyperparameters and selecting relevant features. From the perspective of the operations engineer, there is a handoff from development to production, and the management of GPU clusters to parallelize model training. In the last The post Determined AI: Machine Learning Ops with Neil Conway appeared first on Software Engineering Daily.
AWS has over 150 different services. Databases, log management, edge computing, and lots of others. Instead of being overwhelmed by all of these products, an engineering team can simplify their workflow by focusing on a small subset of AWS services–the defaults. Daniel Vassalo is the author of The Good Parts of AWS. An excerpt from The post The Good Parts of AWS with Daniel Vassallo appeared first on Software Engineering Daily.
The modern release workflow involves multiple stakeholders: engineers, management, designers, and product managers. It is a collaborative process that is often held together with brittle workflows. A developer deploys a new build to an ad hoc staging environment and pastes a link to that environment in Slack. Other stakeholders click on that link, then send The post Pull Request Environments with Eric Silverman appeared first on Software Engineering Daily.
loading
Comments (79)

William Vaughn

Most of what this guy said isn't true. He didn't even mention the BASEL 3 Accords for capital requirements and he was clearly using the discredited "loanable funds" paradigm to explain where investment comes from.

Jul 28th
Reply

Ifedayo Ajibola

Thanks for sharing your knowledge Mohsen. I found it quite insightful. Does this mean Shopify is making a grave mistake though, as they won't be able to use the latest and greatest? 😄

Mar 31st
Reply

Raghu Meda

its a great one. lots of key insights and terms have been discussed in this one which i need to go back and learn. good one thanks

Mar 2nd
Reply

Marian Klühspies

exceptional explanation skills

Mar 1st
Reply

Raghu Meda

its great to listen to this topic. Geoff has shared great detail about what he is building using graphql. he is absolutely right about the future of declarative and semantic schema oriented stuff in UI development. i too strongly believe in low code/no code model going forward and the there are going to be much more evolution in this space and GraphQL is leading the way for building simple low code or no code apps in various gadget screens such as AR, VR, Voice Assistants, IoT device clients, etc. Thanks

Feb 13th
Reply

elrey741

39:26: good walk through kubernetes network acl and deployment

Feb 9th
Reply

elrey741

52:34: HBO example of rook

Feb 6th
Reply

elrey741

49:08: walkthrough of typical interactions for rook

Feb 6th
Reply

elrey741

46:49: operator pattern used w/rook

Feb 6th
Reply

elrey741

43:06: turtles till the bottom... (explaining elastic example -> rook -> ceph -> local storage)

Feb 6th
Reply

elrey741

40:40: ElasticSearch on Ceph

Feb 6th
Reply

elrey741

38:10: ceph is strongly consistent object store

Feb 6th
Reply

elrey741

32:57: storage options that rook provides (object, file, and block)

Feb 6th
Reply

elrey741

31:15: basics of what Rook is (ceph cluster operator)

Feb 6th
Reply

elrey741

19:32: https://github.com/tschuy/cidrblocks

Feb 4th
Reply

elrey741

11:46: templatize manifest on how things are deployed and VCS it.

Feb 4th
Reply

elrey741

11:22: serialized contents of etcd to do backups for disaster recovery

Feb 4th
Reply

elrey741

6:31: have CD system (Jenkins) summarize with all responses and test to send a slack message. then have humans respond in slack to say yes or no. (slackops)

Feb 4th
Reply

elrey741

5:32: use automation in CI and kubernetes deployment reacts to their changes using tools such as the following - go server spec: https://github.com/aelsabbahy/goss - terraform fmt: https://www.terraform.io/docs/commands/fmt.html - terraform plan: https://www.terraform.io/docs/commands/plan.html

Feb 4th
Reply

elrey741

4:29: jenkins and kubernetes to have Jenkins watch git repo to react to changes in your kubernetes/infrastructure changes. then also have it monitor the situations as well

Feb 4th
Reply
Download from Google Play
Download from App Store