Airbyte: Open Source Data Integrations with Michel Tricot and John Lafleur

Open Source Archives - Software Engineering Daily

Open Source Archives - Software Engineering Daily

Player FM - Internet Radio Done Right

287 subscribers

sekiz yıl önce eklendi

İçerik Open Source Archives - Software Engineering Daily tarafından sağlanmıştır. Bölümler, grafikler ve podcast açıklamaları dahil tüm podcast içeriği doğrudan Open Source Archives - Software Engineering Daily veya podcast platform ortağı tarafından yüklenir ve sağlanır. Birinin telif hakkıyla korunan çalışmanızı izniniz olmadan kullandığını düşünüyorsanız burada https://tr.player.fm/legal özetlenen süreci takip edebilirsiniz.

Peak Travel

1
You Can Visit All Seven Continents. But Should You? 26:46

9 gün önce26:46

Daha Sonra Çal

Listeler

Beğen

Beğenildi

26:46

For many travelers, Antarctica is a bucket-list destination, a once-in-a-lifetime opportunity to touch all seven continents. In 2023, a record-breaking 100,000 tourists made the trip. But the journey begs a fundamental question: What do we risk by traveling to a place that is supposed to be uninhabited by humans? And as the climate warms, should we really be going to Antarctica in the first place? SHOW NOTES: Kara Weller: The Impossible Dilemma of a Polar Guide Marilyn Raphael: A twenty-first century structural change in Antarctica’s sea ice system Karl Watson: First Time in Antarctica Jeb Brooks : 7 Days in Antarctica (Journey to the South Pole) Metallica - Freeze 'Em All: Live in Antarctica Learn about your ad choices: dovetail.prx.org/ad-choices…

4 yıl önce 50:42

MP3•Bölüm sayfası

ELT, or “Extract, Load, and Transform,” is the process that modern data pipelines use to replicate data from a source and load it into a target system such as a cloud data warehouse. ELT is a more flexible evolution of the traditional “Extract, Load, Transform” workflow used in pre-cloud systems. The power of ELT relies on flexible integrations between data sources and their targets, called connectors. The wide variety of data sources available to a cloud application today means that an ELT platform needs to handle a vast, and growing set of use cases for its connectors.

Airbyte is an open-source ELT platform built with the “long tail of integrations” in mind. Airbyte is secure, extensible, and simple to set up. Developers can use Airbyte’s platform to build the connectors they need for their specific use case, without worrying about scheduling, orchestrating, or monitoring.

Michel Tricot and John Lafleur are co-founders of Airbyte. Previously, Michel was Head of Integrations at Liveramp building data ingestion connectors, while John was the co-founder of StreamNation, Anaxi, and CEO of CodinGame. Michel and John join the show today to talk about why ELT has changed the way organizations manage and store their data, what technical challenges exist in the world of data integration, and how Airbyte can give your infrastructure “superpowers.”

Sponsorship inquiries: sponsor@softwareengineeringdaily.com

The post Airbyte: Open Source Data Integrations with Michel Tricot and John Lafleur appeared first on Software Engineering Daily.

143 bölüm

#Open Source #Tech #Software Development #Open Source Archives Software Engineering Daily

Open Source Archives - Software Engineering Daily

Airbyte: Open Source Data Integrations with Michel Tricot and John Lafleur

Open Source Archives - Software Engineering Daily

287 subscribers

published 4 yıl önce

Paylaş

MP3•Bölüm sayfası

Sponsorship inquiries: sponsor@softwareengineeringdaily.com

The post Airbyte: Open Source Data Integrations with Michel Tricot and John Lafleur appeared first on Software Engineering Daily.

143 bölüm

#Open Source #Tech #Software Development #Open Source Archives Software Engineering Daily

Tüm bölümler

Open Source Archives - Software Engineering Daily

1
Building a Unified Hardware API at Intel with James Reinders 38:42

1 year önce38:42

38:42

oneAPI is an open standard for a unified API to be used across different computing accelerator architectures. This including GPUs, AI accelerators, and FPGAs. The goal of oneAPI is to eliminate the need for developers to maintain separate code bases, multiple programming languages, tools, and workflows for each architecture. James Reinders is an engineer at Intel and has experience with parallel computing spanning four decades. He joins the show today to talk about oneAPI. This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments. Lee is the host of his podcast, Modern Digital Business , an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm . Follow Lee at softwarearchitectureinsights.com , and see all his content at leeatchison.com . Please click here to see the transcript of this episode. Sponsorship inquiries: sponsor@softwareengineeringdaily.com The post Building a Unified Hardware API at Intel with James Reinders appeared first on Software Engineering Daily .…

Open Source Archives - Software Engineering Daily

1
Building a State Machine Backend with Adam Berger 47:41

1 year önce47:41

47:41

When Adam Berger was at Uber, his team was responsible for ensuring that Uber Eats merchants correctly receive and fulfill orders. This required them to think hard about engineering workflows and state management systems. Six years of experience at Uber motivated Adam to create State Backed , which is an open-source backend system written in Typescript. The platform is oriented around using state machines to model application logic, and automatically handles the associated persistence, infrastructure, and consistency. Adam joins the show to talk about state machines, why they’re the right paradigm to manage global application state, and what are the practical advantages of using state machines in a backend platform. This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought leader on cloud computing and application modernization. His best-selling book, Architecting for Scale (O’Reilly Media), is an essential resource for technical teams looking to maintain high availability and manage risk in their cloud environments. Lee is the host of his podcast, Modern Digital Business , an engaging and informative podcast produced for people looking to build and grow their digital business with the help of modern applications and processes developed for today’s fast-moving business environment. Listen at mdb.fm . Follow Lee at softwarearchitectureinsights.com , and see all his content at leeatchison.com . Please click here to see the transcript of this episode. Sponsorship inquiries: sponsor@softwareengineeringdaily.com The post Building a State Machine Backend with Adam Berger appeared first on Software Engineering Daily .…

Open Source Archives - Software Engineering Daily

1
Open Source Contributing with Brian Douglas 48:01

1 year önce48:01

48:01

The open source coding philosophy has enormous appeal to many software engineers, and with good reason. Open source libraries, applications, and operating systems are now essential to the overall technology ecosystem. And the number of open source projects is only increasing. But many developers don’t know how to get involved in open source. Or, they may have even faced resistance when trying to make a pull request to their favorite open source codebase. Open Sauced is a platform to help developers get involved in open source development. While the number of GitHub stars on a project is often seen as a metric of success for a code base, Open Sauced focuses on the number of new contributors on a project. This number serves as a signal to help drive the platform’s recommendation system, which pairs its users with open source projects in need of developers. Brian Douglas is a former Developer Experience Lead at Netlify and he was the Director of Developer Advocacy at GitHub. He is also the founder and CEO of Open Sauced and he is our guest in this episode. Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more easily, most notably on typescript-eslint: the tooling that enables ESLint and Prettier to run on TypeScript code. Josh regularly contributes to open source projects in the ecosystem such as ESLint and TypeScript. Josh is a Microsoft MVP for developer technologies and the author of the acclaimed Learning TypeScript (O’Reilly), a cherished resource for any developer seeking to learn TypeScript without any prior experience outside of JavaScript. Josh regularly presents talks and workshops at bootcamps, conferences, and meetups to share knowledge on TypeScript, static analysis, open source, and general frontend and web development. You can find Josh on: Bluesky , Fosstodon , Twitter , Twitch , YouTube , and joshuakgoldberg.com . Please click here to see the transcript for this episode. Sponsorship inquiries: sponsor@softwareengineeringdaily.com The post Open Source Contributing with Brian Douglas appeared first on Software Engineering Daily .…

Open Source Archives - Software Engineering Daily

1
Temporal with Max Fateev 41:23

1 year önce41:23

41:23

There are countless real world scenarios where a workflow or process has multiple steps, and some steps must be completed before others can be started. Think of something as simple as cooking dinner. First you look up a recipe, then you write down the ingredients you need, you go shopping, and then you cook. These steps must be run in a certain order, and the state of the workflow must be tracked throughout. Workflow management is everywhere in the software world, and today it’s common for teams to engineer custom solutions. This makes sense, because creating a general-purpose solution for workflow management is a hard conceptual problem, and perhaps an even harder engineering challenge. Maxim Fateev has a deep background engineering distributed systems and workflow management services at Google, Amazon, and Microsoft. In 2015, he joined Uber and helped create the open-source project, Cadence, which is an orchestration engine to execute asynchronous long-running business logic. The success of Cadence led Max to co-found Temporal , which is an open-source programming package for workflow execution. Max joins the show today to talk about the engineering challenges at Temporal, the concept of “durable execution”, how he organizes his engineering teams, and more. Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer. Please click here to see the transcript for this episode. Sponsorship inquiries: sponsor@softwareengineeringdaily.com The post Temporal with Max Fateev appeared first on Software Engineering Daily .…

Open Source Archives - Software Engineering Daily

1
Building Pieces.app and the Future of Developer Productivity with Tsavo Knott 37:49

1 year önce37:49

37:49

Ongoing advances in generative AI are already having a huge impact on developer productivity. Tools like GitHub Copilot and ChatGPT are increasing the velocity of code development, and more advances are on the horizon. However, an ever-growing challenge for developers is how to manage their coding resources – things like code snippets, website links, messages, and screenshots. This is hard for individual developers, but even harder for teams. Tsavo Knott is the Co-Founder and CEO of Pieces . Tsavo thinks deeply about developer productivity and he joins the podcast today to talk about how Pieces is using AI to automate the process of saving, curating, and iterating on coding resources for developers and teams. Full Disclosure: Pieces is a sponsor of Software Engineering Daily Mike Bifulco is CTO and co-founder of Craftwork . He’s also a developer advocate, writer, podcaster and serial startup founder. In past lives, Mike worked for Google, Stripe, Microsoft, and Gymnasium. Mike is also co-founder of APIs You Won’t Hate , a community for API Developers on the web. Mike’s publishes a weekly newsletter for product builders called Tiny Improvements at mikebifulco.com . Mike is on Mastodon at https://hachyderm.io/@irreverentmike Please click here to view this show’s transcript. Sponsorship inquiries: sponsor@softwareengineeringdaily.com The post Building Pieces.app and the Future of Developer Productivity with Tsavo Knott appeared first on Software Engineering Daily .…

Open Source Archives - Software Engineering Daily

1
Simplifying Documentation with Sébastien Lorber 49:52

2 years önce49:52

49:52

In the realm of modern software development, clear and comprehensive documentation is essential for guiding users and contributors alike. Developers often struggle to create, manage, and maintain documentation that is both user-friendly and visually appealing. In this episode, we sit down with Sebastian Lorber , the lead maintainer of Docusaurus , a widely acclaimed open-source static site generator, purpose-built for documentation sites. Sebastian sheds light on how Docusaurus empowers developers to effortlessly build and deploy documentation websites that are functional, maintainable, and easy to brand. This week in React Newsletter Mike Bifulco is CTO and co-founder of Craftwork . He’s also a developer advocate, writer, podcaster and serial startup founder. In past lives, Mike worked for Google, Stripe, Microsoft, and Gymnasium. Mike is also co-founder of APIs You Won’t Hate , a community for API Developers on the web. Mike’s publishes a weekly newsletter for product builders called Tiny Improvements at mikebifulco.com . Mike is on Mastodon at https://hachyderm.io/@irreverentmike Sponsorship inquiries: sponsor@softwareengineeringdaily.com Please click here to view this show’s transcript . The post Simplifying Documentation with Sébastien Lorber appeared first on Software Engineering Daily .…

Open Source Archives - Software Engineering Daily

1
Cloud-native Authorization with Tim Hinrichs 55:40

3 years önce55:40

55:40

Enabling authorization policies across disparate cloud-native environments such as containers, microservices and modern application delivery infrastructure is complex and can be a roadblock for software engineering teams. Open Policy Agent, or OPA, is an open, declarative, policy-as-code approach to authorization that reduces security and compliance burden for engineering teams. Business context is translated into declarative policy statements. These policy statements are compiled into code and deployed as agents that can be injected into any process, such as an API gateway, Kubernetes provisioning service, public cloud access controls, or continuous delivery automation service. Styra created and contributed OPA to the Cloud Native Computing Foundation where it is a graduated project with over 130M downloads to date and is used by large companies. Styra’s enterprise commercial offering, Declarative Authorization Service (DAS), is specifically designed for OPA and includes the ability to author policies, preview impacts of new policies, and document the history of old policies, all through a single view. Tim Hinrichs , CTO and founder of Styra, joins the show today to discuss how to make authorization policies easier to author, distribute, and monitor. One note of disclosure to be aware of: Styra is a portfolio company of Capital One Ventures , the strategic investing arm of Capital One. Views and questions expressed in this podcast and related material are my own, or those of my guest, and do not reflect the views of Capital One Ventures or its respective affiliates. FOLLOW Jocelyn: twitter.com/jocelynbyrne Sponsorship inquiries: sponsor@softwareengineeringdaily.com The post Cloud-native Authorization with Tim Hinrichs appeared first on Software Engineering Daily .…

Open Source Archives - Software Engineering Daily

1
Open-Source Cloud Asset Management with Yevgeny Pats 40:26

3 years önce40:26

40:26

This episode is hosted by Alex DeBrie. Alex is the author of The DynamoDB Book , the comprehensive guide to data modeling with DynamoDB, as well as The DynamoDB Guide , a free guided introduction to DynamoDB. He runs a consulting company where he assists clients with DynamoDB data modeling, serverless architectures, and general AWS usage. You can find more of his work at alexdebrie.com . Nearly all new tech companies build in a public cloud and established companies are rapidly migrating to the cloud from their on-prem data centers. But this move to the cloud can lead to a visibility problem. Cloud Providers offer not only Compute instances but also manage services like databases, blob storage, queues and more. It can be difficult for SRE teams and security departments to understand what is happening across a company’s cloud accounts. Yevgeny Pats is the creator of CloudQuery , an open source cloud asset inventory powered by SQL. CloudQuery allows you to ingest and structure the resources in your cloud accounts so that you can query them using SQL. This allows SRE teams to understand the source of specific resources while security teams can ensure compliance with policies. In this episode we’ll discuss CloudQuery, Yevgeny’s entrepreneurial background and raising funding with an open source project Sponsorship inquiries: sponsor@softwareengineeringdaily.com . The post Open-Source Cloud Asset Management with Yevgeny Pats appeared first on Software Engineering Daily .…

Open Source Archives - Software Engineering Daily

1
InfluxData with Zoe Steinkamp 34:56

3 years önce34:56

34:56

InfluxDB is an open-source time-series database. It’s maintained by InfuxData who offers a suite of products that help organizations gain insights from time-series data. In this episode, I interview Zoe Steinkamp, Software Engineering and Developer Advocate at InfluxData. We explore some of the common use cases for time-series databases such as IoT and some recent announcements such as the ability to run flux queries right inside VS Code. Sponsorship inquiries: sponsor@softwareengineeringdaily.com The post InfluxData with Zoe Steinkamp appeared first on Software Engineering Daily .…

Open Source Archives - Software Engineering Daily

1
Nuxt.js with Alexander Lichter 44:20

3 years önce44:20

44:20

When creating a website, there’s no shortage of choices for how to do it. Builders must make strategic decisions about the language or framework they want to adopt. An important first consideration for many is selecting a web application framework like React or Vue. Motivated by a low page response time and good user experience, many developers want their site to be server-side rendered. Nuxt.js is a free and open-source web application framework based on Vue.js which, among other benefits, brings server-side rendering to Vue.js developers. In this episode, I interview Alexander Lichter, founder of Development and Nuxt.js maintainer. We discuss the features and Nuxt and what role it can play in your next web application. Show Notes: https://blog.lichter.io/ https://vitejs.dev/ https://twitter.com/thealexlichter Sponsorship inquiries: sponsor@softwareengineeringdaily.com The post Nuxt.js with Alexander Lichter appeared first on Software Engineering Daily .…

Open Source Archives - Software Engineering Daily

1
Angular Dev Tools with Minko Gechev 47:07

3 years önce47:07

47:07

Angular is a free and open-source web application framework. It’s maintained by the Angular team at Google. It’s used by millions of web applications and has a strong ecosystem of core contributors and library builders. In this episode, I interview Minko Gechev, Developer Relations Lead at Google. We explore several aspects of open-source software development, Tensorflow.js, Angular, and a few other things worth sticking around for. Sponsorship inquiries: sponsor@softwareengineeringdaily.com The post Angular Dev Tools with Minko Gechev appeared first on Software Engineering Daily .…

Open Source Archives - Software Engineering Daily

1
Distributed Open Source Databases with Jonathan Ellis and Spencer Kimball 1:00:11

4 years önce1:00:11

1:00:11

By most accounts, the first databases came on line in the 1960s. This class of software has continued to evolve alongside the technology it runs on and the applications it supports. In the early days, databases were typically closed source commercial products. Today, databases run in the cloud on distributed systems. Increasingly, the leading tools are open source yet frequently supported by a related commercial entity offering managed services and white glove support. In this episode, we interview Jonathan Ellis, CTO of DataStax and Spencer Kimball, CEO of Cockroach Labs about the current state of distributed databases and the open source ecosystem. Sponsorship inquiries: sponsor@softwareengineeringdaily.com The post Distributed Open Source Databases with Jonathan Ellis and Spencer Kimball appeared first on Software Engineering Daily .…

Open Source Archives - Software Engineering Daily

1
Grouparoo Open Source Data Tools with Brian Leonard 50:55

4 years önce50:55

50:55

ETL stands for “extract, transform, load” and refers to the process of integrating data from many different sources into one location, usually a data warehouse. This process has become especially important for companies as they use many different services to collect and manage data. The company Grouparoo provides an open source framework that helps you move data between your data warehouse and all of your cloud-based tools. This process of moving data back from the data warehouse to the applications is called reverse ETL, and is important for things like marketing campaigns and customer service. It easily integrates with your developer’s tools and is free and easy to install. In this episode we talk with Brian Leonard, CEO at Grouparoo. This interview will also be published as a video episode on our YouTube channel. Sponsorship inquiries: sponsor@softwareengineeringdaily.com The post Grouparoo Open Source Data Tools with Brian Leonard appeared first on Software Engineering Daily .…

Open Source Archives - Software Engineering Daily

1
Publishing Open Source Code with William Morgan 1:00:33

4 years önce1:00:33

1:00:33

In the late 1970s a printer at MIT kept jamming, resulting in regular pileups of print jobs in the printer’s queue. To solve this problem, some computer scientists wrote a software program that alerted every user in the backed up queue “The printer is jammed, please fix it.” When a man named Richard Stallmen was refused a copy of the program code, he resolved to create a publicly available operating system and the open source movement was born ( opensource.com ). Over 50 years later, open source has become a coding philosophy practiced by millions of software engineers around the world. Why is open source so popular? What difference has it really made in software engineering, and what major projects are open source? In this episode we talk to William Morgan, CEO at Buoyant and creator of the open source service mesh Linkerd. Sponsorship inquiries: sponsor@softwareengineeringdaily.com The post Publishing Open Source Code with William Morgan appeared first on Software Engineering Daily .…

Open Source Archives - Software Engineering Daily

1
Wasp-Lang: Boilerplate Code with Matija Sosic 57:37

4 years önce57:37

57:37

The term “boilerplate code” refers to code sections that are repeated across many projects with little to no variation. Every developer is familiar with boilerplate code, whether it be pom.xml files in Java or setting up React.js applications, tweaking boilerplate code for every project is inevitable. Actually, the company Wasp believes writing boilerplate code doesn’t have to be a part of web app development. Wasp is an open-source, declarative DSL for developers who want modern frontend, backend, and deployment experiences without writing boilerplate code. With Wasp, you can describe high-level features with Wasp DSL and write the rest of your logic in React, Node.js, and Prisma. In this episode, we talk to Matija Sosic, CEO and Co-Founder at Wasp. Sponsorship inquiries: sponsor@softwareengineeringdaily.com The post Wasp-Lang: Boilerplate Code with Matija Sosic appeared first on Software Engineering Daily .…

Player FM'e Hoş Geldiniz!

Player FM şu anda sizin için internetteki yüksek kalitedeki podcast'leri arıyor. En iyi podcast uygulaması ve Android, iPhone ve internet üzerinde çalışıyor. Aboneliklerinizi cihazlar arasında eş zamanlamak için üye olun.