What's New? | PI.EXCHANGE

Release 1.6.0: Model Leaderboard, Performance report, and more!

Written by PI.EXCHANGE | Apr 25, 2022 3:00:00 AM

We are excited to announce the latest release of the AI & Analytics Engine - 1.6.0. This release brings about new features, like the Model Leaderboard, Performance Report, and more! The objective of this release is to better the model training and evaluation process.

Model leaderboard

The intention of the Model Leaderboard is to give users a hand in selecting the most appropriate models for them to deploy after they are successfully trained. In the Model Leaderboard, users can view and compare the models in one of the following criteria:

  1. Best prediction quality - The model with the best performance. 

  2. Shortest prediction time - The fastest model to generate predictions for 1000 rows of data

  3. Shortest training time - The model with the shortest training time

This allows users to identify the most appropriate model for their own needs to deploy.


Performance report - Regression

The performance report is a translation of the Engine's findings into comprehensible and precise messages. Users can add, edit, and delete breakpoints in the Prediction Error Breakdown table to see the model’s performance on specific value ranges.

Making, sense-checking, and comparing interactive predictions

Our brand new What-If analysis feature helps users:

  1. Enter individual samples to make prediction outputs;

  2. Compare these individual inputs and outputs side by side; and

  3. Use their domain expertise to evaluate how well their model performed and how to best use their models.

The Engine now automatically recommends a feature set for supervised models

The Engine applies state-of-the-art algorithms to automatically suggest a list of the most impactful columns for your classification and regression models. Users save time by skipping the manual selection process, with the recommended feature set automatically generated.

Model training 2.0

Our engineers have worked around the clock to improve the model performance. With Model Training 2.0 comes:

  • Enhanced data transformation and feature engineering, laying the groundwork for customization in future releases;

  • Support for different types of hyper-parameter tuning methods;

  • Enhanced model evaluation and visualization with useful metrics and charts;

  • Laying the groundwork for supporting new model templates; and

  • Added flexibility to train and serve with different configuration

 

Want to give these new features a go? Sign up for your 2-week trial now!