Pachyderm offers a software platform based on open-source technology that enables data engineering teams for automating replicable data pipelines of any shape or size

houston-campus-min

US-based software startup Pachyderm acquired by HPE. (Credit: Hewlett Packard Enterprise Development LP)

Hewlett Packard Enterprise (HPE) has acquired US-based software startup Pachyderm for an undisclosed price in a move to boost its artificial intelligence (AI) at-scale portfolio.

Pachyderm offers a software platform based on open-source technology that enables data engineering teams to automate replicable data pipelines of any shape or size.

Through the acquisition, HPE is expected to combine Pachyderm’s software with its current supercomputing and AI offerings to automate reproducible machine learning (ML) pipelines for large-scale AI applications.

HPE plans to integrate Pachyderm’s reproducible AI capabilities with its own supercomputing technologies for optimised AI infrastructure and the HPE ML Development Environment, which is a machine learning (ML) software.

By integrating the three on one platform, HPE expects to deliver an advanced data-driven pipeline that automatically refines, prepares, monitors, and handles repeatable machine learning processes used across the development and training environment.

Besides, the integration of Pachyderm’s machine learning pipeline offerings with its existing AI offerings is expected to help HPE facilitate quicker development and deployment of more accurate and performant large-scale AI applications.

The large-scale AI applications are also expected to provide the benefits of data lineage and versioning along with efficient incremental data processing.

HPE HPC and AI executive vice president and general manager Justin Hotard said: “Pachyderm’s unique reproducible AI software augments HPE’s existing AI-at-scale offerings to automate and accelerate AI and unlock greater opportunities in image, video, and text analysis, generative AI, and other emerging large-language-model needs to realise transformative outcomes.”

The transaction is anticipated to complete this month and is not subject to any regulatory approvals.