Release notes

• Added ability to apply custom metric for each app and select specific output fields on which the metric is calculated
• Added a view for weekly quality statistics

• Added support for big payload tasks

‍

• Fixed an issue when updating project metrics

• Get total job count of an app including deleted and relabeled
• Enabled handling of bigger payloads for jobs and tasks responses

• Fixed a issue with catch operations when canceling jobs by project

• Data Program Backend: Balanced CPU utilisation and better autoscaling behaviour for improved throughput.

• Added support for email verification via a one-time code for new user signup

• Added job upload limit for freemium users
• Added prompt before discarding changes on add data page to prevent data loss

• Fixed visibility of selected training name when set under labeler pool restriction
• Fixed the presentation of image instance segmentation datapoints with multiple annotations so that they are rendered once

• New users need to verify email by code

‍

• Added job upload limit for freemium users

• Extended model states: the states of deployed models now mirror the state of the underlying platform.

• Get total job count of an app including deleted and reprocessed

• OCR Extraction Data Program supports automatic entity extraction for trained entities

• Enhanced build process for containers

• Replaced print calls by logger calls.

• Fixed secret passing during the source-to-image build process
• Fixed the conda environment creation and server process initialization during the deployment of AI models.
• Fixed the setup script run during deployment
• Fixed initialization of BaseModel during AI class creation. Now the model is initialized only when predict method is called explicitly.
• Fixed bug in orchestrator selection during deploying.

• Fixed an issue in image instance segmentation data programs that led to an error on task submit

• Automatic pausing of unused model deployments: You can now enable a feature to automatically pause model deployments after a given time  without usage to reduce cost.
• Auditing: You can now track the time your models were online and also how often the models where used for predictions.

• Show call to action when project's task design doesn't match parameters supported by current data program

• Improved data point detail view layout

• Improved latency for model predictions in the case when another model is under heavy load

• Enhanced error message when unsupported file types dragged and dropped

• Start again link during project creation now works correctly when using sample datasets
• Suggestions panel only visible when suggestions available
• Adjusted project creation process for Free Trial projects which use AI

• Auto saving response no longer gets marked as completed on expiration

• Autosave your work in the labeling interface after 5 seconds of inactivity

• No longer need to choose who labels your data when the project type only uses AI for data processing

• Unprocessed Markdown text no longer displays momentarily in the instructions within the labeling interfaces

• Create and deploy models locally and remotely with Amazon SageMaker
• Version your AI models. Create copies of models whenever you adjust weights or other parameters. Every model version remains operational and accessible.
• Adjust weights and other parameters on your models
• Add models to a project
• Assign models for pre-labeling. Use a model to provide suggestions for human labelers to accept, adjust, or ignore in the labeling interface.
• Directly predict using deployed models. Use prediction to debug your model or provide a direct labeled output.
• Deploy and test models locally with new CLI tools

• Enjoy more detailed SDK log outputs thanks to Rich library implementation
• Automatically verify model responses to ensure compatibility with super.AI schema
• Shorter build time for AI containers through staged builds using a source-to-image package

• How to create and manage organizations page added

• Fixed 202 response when using `job_responses` endpoint

• Training can now be accessed by users with owner, admin, or instructor roles

• View email addresses of workers involved in each task In the data point details view. For video bounding box keypoint projects, it's also possible to see who annotated each object in each frame.

• No trainings shown on partners page when trainings are not available
• Work queue shows status of ongoing async operations (large batches of relabelings, cancellations, etc.)
• Disqualify workers from tests
• Improved performance of data point details view for video bounding box keypoint projects
• Improved initial page load time

• Scroll between data points in tutorial content and view explanation beside selected data point

• You can now complete all the outputs in exclusive choice labeling interfaces, even when the options are the same between questions

• Ouput coordinates from video bounding box keypoint, image bounding box, and image polygon labeling interfaces preserve fractional numbers

• Work queue is now more consistent with backend data updates
• Human vs AI statistics now appear on the Statistics page when they're meant to

• See what type of workers (AI, human) were involved in labeling the data point in the data point details view
• See how many data points were labeled by "Human + AI" on the statistics page of a project
• Copy text input data in data point or task details view to clipboard
• Invite users as Instructors to create tutorials and tests within a project

• Project settings page loads faster

• Data points load in the work queue even when there are updates occurring on those data points
• Markdown displays correctly in the task details view

• Settings page loads without requiring a response from the metrics API endpoint

• Choose which data points you want to update when changing project settings

• Image redaction project type released
• Prelabeling available on projects with text inputs

• Input data displays correctly when navigating through data points
• Bounding box height no longer arbitrarily limited when using auto segmentation tool in image instance segmentation labeling interface
• `data://` URLs containing whitespaces work when used in instructions

• Create organizations
• Invite workers
• Create worker groups
• Create project tutorials
• Create project tests

• Welcome page loads better
• Task count displays correctly
• Video bounding box labeling interface no longer becomes unresponsive

• Upload data points via PDF

• Draw polygons using keypoints as vertices in video bounding box keypoint labeling interface

• Add and remove AI models within projects
• See AI vs human labeling stats in AI-enabled projects

• You can merge instances again in video bounding box keypoint projects

• Geodata projects no longer crash when loading geodata files

• Icon tweaks
• Geodata project supports line and point annotations

• Dashboard no longer freezes up after data point submission
• Entering data points tags no much smoother

• Geodata polygon Data Program
  

• ‍Label Myself button now displays as soon as data points are ready for labeling

• You can now submit large batches of jobs through the dashboard

• Delete people from your projects

• Free trial on selected Data Programs
• Test Data Programs out with sample data and settings

• You can no longer create a negative number of jobs
• ‍Label myself button updates much more quickly
• Labels sync better with video playback

‍

• Adding or editing a keypoint makes a keyframe in video bounding box keypoint labeling interface

• Tag list is no longer cleared every 3 seconds
• Task-level view renders inputs and outputs correctly

• Zoom now works correctly in the labeling interfaces and data point details view for image structured, image instance segementation, and video bounding box projects
• Auto-segmentation tool add/remove dots working correctly again
• You can now zoom in on images that have whitespaces in their URLs

• Made it easier to draw rectangular polygons in the image polygon labeling interface

• Image polygon labeling tool
  

• Dropdown menu during initial project design now works

• Add and monitor AI models within your project
• Automatically track objects in video bounding box labeling interface

• View task-level details

• Maintain correct order in data point details view when a new message is added

• Speed up your labeling with pre-labels in image instance segmentation
• Confirm whether you want to update data points when making changes to your project

• Multiline CSV supported first designing a project

• See output update automatically when you send a data point for relabeling from the data point details view

• Specify initial locations of keypoints in video bounding box keypoint projects

• Tags now load up immediately when using the work queue filter

• View and download previous data point versions
• Try out 7 new filters in the job queue

• View line numbers in named entity recognition labeling interface

‍

• Reduced the number of error toasts in the dashboard
• Model confidence column now shows Calculating when in progress

• Image thumbnails now always show up after upload on the Add data screen
• Image segmentation bucket fill tool now only fills contiguous pixels

• Use auto-segmentation and highlight uncovered areas in the image segmentation labeling interface
• Leave feedback on data points you or your team label
  

• Named entity recognition task design improved

• Model confidence score bugfixes
• Labeling interface no longer glitches when using the pen tool

• Filter by active learning score in the job queue
• Add position-of-speech tags using checkboxes in task design for named entity recognition projects

• Merging objects in video bounding box labeling interface works again

• Zoom and use scroll bar to navigate frames in video bounding box frames pane

• Use keyboard shorcuts to navigate between frames in video bounding box labeling interface

• Merge two or more objects in video bounding box labeling interfaces

• Fixed broken link to documentation from dashboard updates

• Undo and redo, convert keyframe to interpolated frame, and extend bounding box to previous frames in video bounding box labeling interface

• Image bounding box labeling interface gets a major upgrade
• Improved mouse trackability in labeling interface
• Made it easier to draw bounding boxes at the border of images and videos

• Label myself button now keeps up to date
• Edit output interface now uses the right frames per second value in video bounding box

• View messages from your labelers

• Tidied up rendering of data point inputs and outputs

• Delete data points

• Park your data points

• Admins and reviewers can view and edit ground truth

• Adjust project settings on new Settings page

• Search project types by input and output data types

• You can no longe submit project designs with invalid values

• View feedback from labelers on data points
• Update project design without creating a new project
• Add tags to data points

• Archive projects

• Project list overhauled

• Submit data point in the Parked state

• Improved stability and resource usage in image segmentation labeling interface and CSV data point submission process

• Image segmentation tasks no longer hang in the labeling interface

• Updated image segmentation labeling interface
• Updated programmatic data point submission instructions

• Masks render correctly in image segmentation labeling interface

• Interactively edit outputs and ground truth data in video bounding box, NER, and audio segmentation projects

• Export data point outputs, feedback, and file URLs in CSV format

• Notification banner shows when data points are in the process of being created after submission