Research consultant

New TDWI Research Report Explores Unified Data and Analytics Pipelines | News

Seattle, Wash., April 15, 2022 (GLOBE NEWSWIRE) — TDWI Research released its latest TDWI Best Practices Report: Unifying Data Management and Analytics Pipelines. This original, survey-based report focuses on the current state of DataOps and MLOps in modern organizations and highlights the trend towards unification of these two types of pipelines.

The report’s author, James Kobielus, is TDWI Research’s senior manager for data management. He explains that there is tremendous growth potential in the adoption of unified DataOps and MLOps pipelines in today’s enterprise environments.

In the report, Kobielus points out that “both [DataOps and MLOps] leverage and expand company investments in unified analytics, data engineering, data governance and curation, data science and statistical modeling, and metadata management. Both require a high-performance pipeline in which data and models are prepared, packaged, tested, and deployed into useful applications. He adds that both derive value from integrating with continuous integration and deployment pipeline tools often referred to as DevOps.

The report takes an in-depth look at DataOps and MLOps methods and examines how these practices align with continuous integration/continuous deployment methods more closely associated with DevOps, particularly in cloud environments.

Report Highlights

This comprehensive report reveals several key findings:

For more than half of survey respondents, ETL and related processes are the primary use case for DataOps. About the same number think their DataOps pipelines aren’t structured well enough for optimal integration, governance, quality, or compliance. Lack of standardized processes for data and analytics teams. has been reported as a major challenge for managing DataOps and MLOps pipelines

The report also includes a case study of an organization’s successful pipeline unification project, which involves a unified DataOps/MLOps pipeline that integrates with a data lake and implements a DevOps CI/ Automated CD.

The report concludes with six best practice recommendations to help readers align and unify DataOps and MLOps pipelines in their organizations.

This research was sponsored by Incorta, Matillion, SAP and Snowflake.

Download the report here.

Watch the webinar live April 20 at 9:00 a.m. PT, 12:00 p.m. ET and on demand thereafter.

About the Author

JAMES KOBIELUS is TDWI Research’s Senior Director for Data Management, focusing on data management. He is a seasoned industry analyst, consultant, author, speaker, and blogger in the field of data analytics and management. Kobielus focuses on advanced analytics, artificial intelligence and cloud computing. Previously, he held positions at Futurum Research, SiliconANGLE Wikibon, Forrester Research, Current Analysis, and The Burton Group, and was Senior Program Manager, Product Marketing for Big Data Analytics, for IBM, where he was both a subject matter expert and strategist on thought leadership and content marketing programs for the data science community. You can reach him by email (jkobielus@tdwi.org), on Twitter (@jameskobielus) and on LinkedIn (https://www.linkedin.com/in/jameskobielus/).

About TDWI

For over 25 years, TDWI has provided individuals and teams with a comprehensive portfolio of business and technical training and research on all things data. TDWI’s deep, best-practice knowledge can be quickly applied to develop world-class talent in your organization’s business and IT functions to improve analytical and data-driven decision-making. TDWI offers major conferences as well as topical seminars, on-site training, memberships, certifications, live webinars, resource-rich publications, industry news and in-depth research. To see tdwi.org or follow us on Twitter @TDWI.

About 1105 Media

1105 Media, Inc. is a leading provider of integrated news and media in targeted business-to-business markets, including specialized sectors of the information technology community; industrial health, safety and compliance; Security; environmental protection; and home care. 1105’s offerings cover print and online magazines, journals and newsletters; seminars, conferences and trade shows; training courseware; and web services. 1105 Media is based in Woodland Hills, California with offices across the United States

###

Attachment

TDWI Best Practices Report: Unifying Data Management and Analytics Pipelines

Sabrina Bozek TDWI 425.277.9175 sbozek@tdwi.org