LogoLogo
Home
Core Platform
Core Platform
  • Introduction
    • Overview
    • Use Cases
    • Architecture
    • Built with ML & AI
    • Quick Start
  • Examples
    • Training Examples
      • API Flow Examples
      • Microservice Examples
      • UI Example
      • Exercise: Hello World API
      • Exercise: Test State
      • Exercise: Test UI
    • Exercise: To-do List
      • To-do List Runner
      • To-do List Gateway
      • To-do List UI
      • To-do List Query
  • Troubleshooting
    • Rierino Packages
    • Release Notes
    • Useful Checks
    • Error Codes
  • Devops
    • Overview
    • API Flows
      • Using the Saga Screen
      • Defining a Saga
      • Configuring Saga Steps
        • Event Step
        • Transform Step
          • Transform Classes
        • Condition Step
          • Condition Classes
        • Step Link
      • Injecting Variables
    • Microservices
      • Runners
        • Using the Runner Screen
        • Defining a Runner
        • Managing Runner Settings
        • Adding Runner Elements
        • Deploying Runners
          • Spring Runners
          • Samza Runners
          • Camel Runners
      • Elements
        • Systems
        • State Managers
          • Typical Use Cases
          • State Data Structure
          • Local States
            • In-Memory Map
            • Caffeine Cache
            • Samza Based
            • Lucene Based
            • Single File
            • Multiple Files
            • Selected IDs Map
            • Indexed Map
          • Shared States
            • MongoDB Collection
            • Jooq (SQL) Table
            • Redis Map
            • Couchbase Collection
            • Elasticsearch Index
            • Elasticsearch Joined
            • Etcd Namespace
          • Specialized States
            • CRUD Service
            • Odata Service
          • State Coordinators
            • Lazy Cache Coordinator
            • Event Store Coordinator
            • Write thru Coordinator
          • Loading Strategies
          • ID Generators
        • Listeners
        • Query Managers
          • MongoDB
          • Elasticsearch
          • Lucene
          • SQL Based
          • Odata Service
        • Handlers
          • Core Handlers
            • Write Data
            • Read Data
            • Query Data
            • Apply Rules
            • Call Rest API
            • Generate Text/Html
            • Parse Html
            • Generate Secrets
            • Orchestrate User Task
            • Perform File Operation
            • Run Shell Command
            • Send/Receive Emails
          • Custom Code Handlers
            • Run Scripts
            • Run Java Code
            • Run Java Package
          • Flow Handlers
            • Orchestrate Saga
            • Loop Each Entry
            • Run Multiple Steps
            • Buffer Payloads
            • Merge Parallel Steps
            • Log Event
            • Send Event
            • Validate Event
            • Transform Event
            • Perform DB Transaction
            • Trigger Runner Command
            • Do Nothing
            • Modify Role Data
            • Enrich Role Data
            • Convert Pulse to Journal
          • Gateway Handlers
            • Authenticate
              • No Authentication
              • State Based
              • Keycloak Based
            • Sessionize
          • Specialized Handlers
            • Apply Advanced Rules
            • Calculate Real-time Metrics
            • Score ML Models
            • Score LangChain Models
            • Service MCP Requests
            • Service A2A Requests
            • Consume Web of Things
            • Perform Text Embedding
            • Run Python Procedure
            • Generate Excel
            • Generate PDF
            • Call SOAP API
            • Integrate with Camel
        • Actions
        • Streams
          • Kafka Topic
          • CDC Feed
          • Camel Component
        • Roles
        • Generic Settings
        • Global Settings
      • Deployments
        • Defining a Deployment
        • Alternative Loaders
    • Gateway & Security
      • Gateway Servers
        • Gateway Systems
        • Gateway Channels
        • Gateway Services
        • Gateway Tokens
      • APIs
        • OpenAPI Specification
        • Response Formats
    • Administration
      • Managing Deployments
      • Sending Commands
      • Streaming Messages
      • Migrating Assets
    • Batch Tasks
      • Python Processes
      • Python Iterators
      • Python Processors
    • Pro-Code
      • Custom Handlers
      • Custom State Managers
      • Custom Query Managers
      • Custom CDC Managers
  • Design
    • Overview
    • User Interface
      • Apps
      • UIs
        • Listers
        • Widgets
          • Value Widgets
          • Array Widgets
          • Object Widgets
          • Indirect Widgets
          • Atom Widgets
        • Menus
          • Lister Menu Actions
          • Selection Menu Actions
          • Editor Menu Actions
          • Widget Menu Actions
          • Custom Menu Actions
          • RAI Menu Actions
        • Extended Scope
          • Conditional Display
          • Data Context
          • Extra Data
          • Default Item
          • Extra Events
      • Options
      • Translations
      • Icons
      • Styles
      • Components
    • API Mapping
    • Data Schema
      • Common Data
  • Configuration
    • Overview
    • Queries
      • Query Types
      • Query Platforms
        • MongoDB Queries
        • Odata Queries
        • SQL Queries
        • Elasticsearch Queries
        • Lucene Queries
        • Siddhi Queries
    • Business Rules
      • Drools Rules
    • Dynamic Handlers
  • Data Science
    • Overview
    • ML Models
      • Scheduler Platforms
        • Airflow Scheduler
    • GenAI Models
      • AI Agent APIs
      • Useful Checks
    • MCP Servers
    • Complex Event Processing
      • Siddhi Data Flows
    • Data Visualizations
    • Customizations
  • EXTENSIONS
    • JMESPath
    • Handlebars
Powered by GitBook

© Rierino Software Inc. 2025. All rights reserved.

On this page
  • Handler Parameters
  • Actions
  • Score / ScoreML
  • Versions
  • TensorScoreEventHandler
  • OnnxScoreEventHandler
  • PMMLScoreEventHandler
  • OpenNLPScoreEventHandler
  1. Devops
  2. Microservices
  3. Elements
  4. Handlers
  5. Specialized Handlers

Score ML Models

This set of handlers provide ability to run real-time inference using various machine learning libraries, which share the same set of parameters and actions.

PreviousCalculate Real-time MetricsNextScore LangChain Models

Last updated 5 months ago

Handler Parameters

This handler is .

Parameter
Definition
Example
Default

model.state

Name of the state manager with model configurations

model

-

model.id

Id of the model to run on this instance

recommendation

-

model.store.system

Name of the system to store model assets

hdfs_default

-

model.local.dir

Local directory to store model assets for execution

/tmp

java.io.tmpdir

Actions

Score / ScoreML

Scores input data using pretrained model managed by this handler. Event metadata fields applicable for this action are as follows:

Field
Definition
Example
Default

inputElement

Json path for the input in request event payload

parameters

-

outputElement

Json path for the output in response event payload

$.score

-

With event metadata parameters as:

Parameter
Definition
Example
Default

inputPattern

JMESPath pattern to apply on data input

[ [text] ]

-

outputPattern

JMESPath pattern to apply on data output, before returning response

{totalPrice:basket.totalPrice}

-

Versions

TensorScoreEventHandler

implementation (group:'com.rierino.custom', name: 'tensor', version:"${rierinoVersion}")

OnnxScoreEventHandler

implementation (group:'com.rierino.custom', name: 'onnx', version:"${rierinoVersion}")

PMMLScoreEventHandler

implementation (group:'com.rierino.custom', name: 'pmml', version:"${rierinoVersion}")

OpenNLPScoreEventHandler

implementation (group:'com.rierino.custom', name: 'opennlp', version:"${rierinoVersion}")

This handler (com.rierino.handler.tensor.TensorScoreEventHandler) uses library for inference using saved models.

This handler requires the following dependency added to :

This handler (com.rierino.handler.onnx.OnnxScoreEventHandler) uses library for inference using models saved using this common format.

This handler requires the following dependency added to :

This handler (com.rierino.handler.pmml.PMMLScoreEventHandler) uses formatted models for inference.

This handler requires the following dependency added to :

This handler (com.rierino.handler.opennlp.OpenNLPScoreEventHandler) uses library for inference using common NLP tools, saved dictionaries and models.

This handler requires the following dependency added to :

Tensorflow
deployment contents
ONNX Runtime
deployment contents
PMML
deployment contents
OpenNLP
deployment contents
cacheable
519B
handler-tensor-0001.json
Example Tensorflow Model Handler Definition (Can be Imported on Element Screen)