data-profiling

Create HTML profiling reports from pandas DataFrame objects

Visualize and compare datasets, target values and associations, with one line of code.

🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF and PySpark

Data validation and organization of metadata for data frames and database tables

Data profiling, testing, and monitoring for SQL accessible data.

Monitor the stability of a pandas or spark dataframe ⚙︎

🚕 A spreadsheet-like data preparation web app that works over Optimus (Pandas, Dask, cuDF, Dask-cuDF and PySpark)

a set of scripts to pull meta data and data profiling metrics from relational database systems

Dataset search engine, discovering data from a variety of sources, profiling it, and allowing advanced queries on the index

The official http://raymon.ai data profiling and logging library.

A Node.js tool to examine the correctness of Open Data Metadata and build custom dataset profiles

Data cleaning tool.

Open Data Profiling, Quality and Analysis on NYC OpenData dataset with semantic profiling using fuzzy ratio, Levenshtein distance and regex

Simplify usage of the RDS API for TypeScript/JavaScript developers

R package to simplify the usage of the RDS REST API and provide convenience in accessing data and metadata.

HPCC Systems ECL bundle that provides some basic data profiling and research tools to an ECL programmer

TypeScript/JavaScript example code using the RDS API

Automated exploration of files in a folder structure to extract metadata and potential usage of information.

Profile. Generate data profiles in the browser (work in progress)

The program compares two files at a time and does the following 1.Gathering metadata on the individual tables(column count,record count,list of columns with datatype etc) 2.Identifying matching columns between tables based on names as well as data. Using machine learning, we are handling syntactic as well as semantic variations of column names for accurate matching. 3. Finding duplicate columns in single table with the option to deduplicate if required 4. Finding columns with missing data/null values.

Distributable UCC Discovery Algorithm based on Akka

Project to develop R scripts to capture, validate and analyze loan information from credit unions peruvian sector.

a nix DataProfiler for deep analysis of data quality on tabular files

Data profiler is an attempt to model the behavior of a given operator for a set of datasets.

A R Notebook to perform basic data profiling and exploratory data analysis on the FIFA19 players dataset and create a dream-team of the top 11 players considering various player attributes.

Python function to generate a mask analysis

Map naturally-occurring inter-subreddit content sharing patterns on Reddit by analyzing how posts are “cross-posted" between subreddits based on 2.5 million posts across the top 2,500 subreddits. Uses ECL and HPCC Systems.

MetricDoc is an interactive visual exploration environment for assessing data quality