An Intro To Workflow Management With Prefect Kevin Kho Pydata Global 2021

Kevin Kho Pydata Global 2021 Prefect is an open source workflow management system designed for large scale data processes. we'll show how to get started with prefect and also cover how to run prefect on top of dask. This talk will show data engineers and scientists how to orchestrate their data workflows with prefect. after this talk, attendees should understand the basics of workflow orchestration and how to get started implementing it for their use cases.

Home Pydata Global 2021 My name is kevin kho. i am currently working on fugue, a minimal interface to bring python, pandas, and sql code to spark, dask, and ray. recently, i was at prefect as an open source community engineer where i managed the slack community and created content. Most of my conference talks are about workflow orchestration with prefect and working with big data using fugue. i am always happy to give any of these talks at meetups or internal company events. Kevin kho is an open source community engineer at prefect, an open source workflow orchestration management system. previously, he was a data scientist at paylocity, where he worked on adding machine learning features to their human capital management (hcm) suite. This talk will show data engineers and scientists how to orchestrate their data workflows with prefect. after this talk, attendees should understand the basics of workflow orchestration and how to get started implementing it for their use cases.

Keynote Speakers Pydata Global 2021 Kevin kho is an open source community engineer at prefect, an open source workflow orchestration management system. previously, he was a data scientist at paylocity, where he worked on adding machine learning features to their human capital management (hcm) suite. This talk will show data engineers and scientists how to orchestrate their data workflows with prefect. after this talk, attendees should understand the basics of workflow orchestration and how to get started implementing it for their use cases. Prefect | intro to workflow management with kevin kho | dask summit 2021 dask • 4.2k views • 4 years ago. In an interactive demo, we’ll go over prefect basic concepts such as flows, tasks, and parameters. we’ll then move on to more advanced topics such as mapping and conditional logic, which let us dynamically create tasks inside a flow. My name is kevin kho. i am currently working on fugue, a minimal interface to bring python, pandas, and sql code to spark, dask, and ray. most recently, i was at prefect as an open source community engineer where i managed the slack community and created content. Kevin kho is an open source community engineer at prefect, an open source workflow orchestration management system. previously, he was a data scientist at paylocity, where he worked on adding machine learning features to their human capital management (hcm) suite.

Sprints Pydata Global 2021 Prefect | intro to workflow management with kevin kho | dask summit 2021 dask • 4.2k views • 4 years ago. In an interactive demo, we’ll go over prefect basic concepts such as flows, tasks, and parameters. we’ll then move on to more advanced topics such as mapping and conditional logic, which let us dynamically create tasks inside a flow. My name is kevin kho. i am currently working on fugue, a minimal interface to bring python, pandas, and sql code to spark, dask, and ray. most recently, i was at prefect as an open source community engineer where i managed the slack community and created content. Kevin kho is an open source community engineer at prefect, an open source workflow orchestration management system. previously, he was a data scientist at paylocity, where he worked on adding machine learning features to their human capital management (hcm) suite.

Pydata Global 2024 My name is kevin kho. i am currently working on fugue, a minimal interface to bring python, pandas, and sql code to spark, dask, and ray. most recently, i was at prefect as an open source community engineer where i managed the slack community and created content. Kevin kho is an open source community engineer at prefect, an open source workflow orchestration management system. previously, he was a data scientist at paylocity, where he worked on adding machine learning features to their human capital management (hcm) suite.

Pydata Global 2024