Data profiling, or data discovery, refers to the process of obtaining information from, and descriptive statistics about, various sources of data. The purpose of data profiling is to get a better understanding of the content of data, as well as its structure, relationships, and current levels of accuracy and integrity. Read More
Note: This article was originally drafted in 2015, but was updated in 2019 to reflect new integration between IRI Voracity and Knime (for Konstanz Information Miner), now the most powerful open source data mining platform available. Read More
One of the best ways to speed up big data processing operations is to not process so much data in the first place; i.e. to eliminate unnecessary data ahead of time. Read More
In 1992, Digital Equipment Corporation (DEC, long since acquired) asked IRI to develop a 4GL interface to CoSort in the syntax of the VAX VMS sort/merge utility. Read More
The sort included with each Unix-based operating system is a standard command line program that prints lines of input or specified input files in the specified sorted order. Read More
Finding more speed when loading big data is a challenge in ETL, reorg, and very large database (VLDB) index populate operations. Read More
Big Data Problem Big data volumes are growing exponentially. This phenomenon had been happening for years, but its pace began a more rapid acceleration in 2012. Read More
Hadoop is an increasingly popular computing environment for distributed processing that business can use to analyze and store huge amounts of data. Some of the world’s largest and most data-intensive corporate users deploy Hadoop to consolidate, combine and analyze big data in both structured and complex sources. Read More
One of the main concerns DBAs who need to unload big data from very large database (VLDB) tables have is speed. Faster unloading makes data accessible in different forms for different purposes and platforms. Read More
IRI CoSort is the world’s #1 sort, and single-pass “super tool” for data transformation, reporting, and more. Use CoSort to migrate legacy sorts and data, accelerate BI, DB, and ETL tools, and replace SQL, shell scripts, and 3GL programs that can’t transform fast enough. Read More
IRI Voracity is an affordable data management platform that streamlines information architectures and helps enterprises leverage the intrinsic value of data without the cost or complexity of multiple tools. Read More
