Say Hello to UTF-8 Support in CoSort
Thanks to the Internet, the IT world is now a smaller place, too. Information conveyed in different languages must be accurately represented in multiple data sources, email clients, and applications. Read More
Date Format Masking
Note: This article, first published in 2014, refers to date reformatting technology in the SortCL data manipulation program central to the IRI CoSort data transformation product and larger IRI Voracity data management platform. Read More
Standard Deviation, A Predictive Analytic Tool in CoSort
About Standard Deviation
Standard Deviation is a statistical measure of variance between data values and their mean (or average value). Standard deviation is calculated as the square root of that variance. Read More
Automate IRI Data Integration Jobs with Oracle Job Scheduler
Job schedulers are computer programs controlling other program executions behind the scenes, or as part of batch processes. This workload automation is typically coordinated so that traditional background data processing can be integrated with real-time business activities without depleting resources or interfering with other applications. Read More
Multiply Aggregation
As CoSort users have known for a long time, the Sort Control Language (SortCL) program supports multi-level, conditional aggregation functions on a static or running basis. Read More
New Features in CoSort 9.5.3
Editors note: CoSort Version 10 was released in mid-2018. Please see this article for links to its features and upgrade details.
What’s New in CoSort 9.5.3
Along with the new website, there is a new release of IRI’s flagship CoSort package for data management and data protection. Read More
ETL vs ELT: We Posit, You Judge
Full disclosure: As this article is authored by an ETL-centric company with its strong suit in manipulating big data outside of databases, what follows will not seem objective to many. Read More
Data Profiling: Discovering Data Details
Data profiling, or data discovery, refers to the process of obtaining information from, and descriptive statistics about, various sources of data. The purpose of data profiling is to get a better understanding of the content of data, as well as its structure, relationships, and current levels of accuracy and integrity. Read More
Using the Metadata Discovery Wizard
IRI’s data management tools share a familiar and self-documenting metadata language called SortCL. All these tools — including CoSort, FieldShield, NextForm, and RowGen — require data definition file (DDF) layouts with /FIELD specifications for each data source so you can map your data and manage your metadata. Read More
Using Selection to Reduce Data Bulk (and Improve Data…
One of the best ways to speed up big data processing operations is to not process so much data in the first place; i.e. to eliminate unnecessary data ahead of time. Read More
Informatica Pushdown Optimization with CoSort
Big data integration activities can happen outside the database in an extract, transform, load (ETL) environment, or inside the database in ELT:
http://www.iri.com/blog/data-transformation2/etl-vs-elt-we-posit-you-judge/
One example of an ELT operation would be Informatica’s Pushdown Optimization option, in which users transform data in a relational database like Oracle, or in Teradata. Read More