Data Discovery in Eclipse

ER Diagramming

Define enterprise-wide data class libraries, automatically search your sources and catalog the data in them, and then apply transformation and protection rules that you matched to your classes.

Data Classification

Define enterprise-wide data class libraries, automatically search your sources and catalog the data in them, and then apply transformation and protection rules that you matched to your classes.

Metadata Discovery

Connect to structured and semi-structured files and relational databases. Define or re-define column names, offsets, and data types so you can save, share, and re-use the metadata for your data sources in central data definition files (DDFs) that are compatible with every IRI software application.

Metadata Imports

Integrated COBOL copybook and JCLsort parrmconverters, ASN.1 CDR and XLS/X file readers, XML and JSONparsers, and support for external data classification and discovery results also produce IRI-compatible data definitions or job configurations to save you time. In addition, third-party tools like Quest Mapping Manager, MITI MIMBand DataSwitchcan automatically generate the same IRI DDF from a wide variety of ETL, BI and data modeling applications so you can be that much closer to processing the same data in the IRI Voracity platform to save time and money. Read More

Database Profiling

Compile statistics, check referential integrity, and search for lookup, string-, pattern-, and fuzzy-matching values in any JDBC-connecteddata source.

Flat-File Profiling

Compile statistics, and search for lookup, string-, pattern-, and fuzzy-matching values in any sequential file format that IRI supports.

Schema Data Class Search

Find and leverage all data schema-wide that matches attributes of your data classes or data class groups. Automatically scan through every column in the schema rather than one table at a time. Use this in conjunction with the Data Class DB Masking wizard.

There is also a Directory Data Class Search (and corresponding Data Class File Masking) wizard in the IRI FieldShieldmenu olfIRI Workbench to find and de-identify PIIin one or more flat-files distributed across a LAN. Note that IRI DarkShield also supports the same data classes and masking functions for RDBschema as well; see the differences between them here.

Directory Data Class Search

The Directory Data Class Search wizard in IRI Workbench (WB) matches data in structured files within one or more directories to configured data classes. The search process compares the matchersin the data classes with the data in those files to determine the best match, if any. The matcherscan be either patterns or set file lookups. If only a few, selected structured files need to be searched, use the Data Class Library editor for faster results.

Dark Data Discovery

Find and report on data in semi-structured and unstructured sources on-premise or in the cloud, including: MS Office and Outlook files, .pdfand .rtfdocuments, relational and NoSQLdatabases, JSON, XML, EDI, and other text (log) files, plus images in many formats. Leverage one or more search methods at the same time, including Regex pattern matches, exact or fuzzy matches to lookup values, and multiple NERmodel frameworks using semi-supervised machine learning. You can also extract that dark data and its associated metadata into flat, query-ready DDF files and simultaneously mask or replace it with IRI DarkShield.

Data Quality Assessment

Use pattern definition and computational validation scripts to locate and verify the formats and values of data you define in data classes or groups (catalogs) for the purposes of discovery and function-rule assignment (e.g., in Voracity cleansing, transformation, or masking jobs). You can also use SortCLfield-level if-then-else logic and \'iscompare\' functions to isolate null values and incorrect data formats in DB tables and flat files. Or, use outer joins to silo source values that do not conform to master (reference) data sets. Use data formatting templates and their date validation capabilities, for example, to check the correctness of input days and dates

Read More