oJob-common

A set of base oJobs as common building blocks for custom oJobs.

Check the documentation for some of them:

oJob-common	Description
oJobBasics	Basic init/done logging, sh command execution, etc.
oJobEmail	Send emails.
oJobSSH	SSH to execute commands and upload/download files.
oJobSQL	Query or execute SQL to a JDBC database.
oJobES	Logging to ElasticSearch
oJobNet	Testing network connectivity
oJobHTTPd	Building a simple HTTP(s) server
oJobRest	Building a simple REST server
oJobBrowse	HTTP file browsing with customizable templates
oJobMCP	MCP (Model Context Protocol) server functionality
oJobOPack	Simplified OPack creation
oJobRAID	Simplified RAID AF operation execution.
oJobWatchDog	Helps build a cron-based process "watchdog".
oJobCh	Channel operations (buffering, waiting)
oJobIO	File I/O operations (copy, move, append, etc.)
oJobTest	Testing functionality with assertions and reports
oJobXLS	Excel file operations
oJobGIT	GIT repository operations
oJobDebug	Debug utilities

oJobBasics

oJobBasics jobs
oJob Start and Stop helpers
oJob Sleep utilities
oJob sh
oJob Stringify
oJob Set
oJob Path Set
oJob YAML
oJob Sort Array
oJob Map Array
oJob Map
oJob Split into items
oJob Print list
oJob Print args
oJob Get kept result
oJob Keep result
oJob Switch
oJob Sec Get
oJob background processes
oJob From global
oJob Args from JSON
oJob Args from YAML
oJob Jobs Report

oJob Start and Stop helpers

These utility jobs provide a consistent start/stop lifecycle:

oJob Start – emits an init log entry when processing begins.
oJob Stop – emits a done log entry when processing is complete.
oJob Shutdown – equivalent to oJob Stop but runs on shutdown so it can perform cleanup.
oJob Exit – terminates the current script immediately with exit code 0.

oJob Sleep utilities

Two convenience jobs delay execution by a fixed interval:

oJob Sleep 1s – sleeps for 1 second (1000 ms).
oJob Sleep 5s – sleeps for 5 seconds (5000 ms).

oJob sh

This job runs a local shell command and accepts the following arguments:

Argument	Type	Mandatory	Description
cmd	String/Array	Yes	The command to execute (or an array of commands)
quiet	Boolean	No	Determines if the stdout should be visible or not (default is false)
directory	String	No	Sets the working directory for the command
stdin	String	No	Provide any stdin needed
exitcode	Number	No	Determines what exitcode should be consider success (default is 0)
stdout	String	No	Captures the command stdout when `quiet` is true
stderr	String	No	Captures the command stderr when `quiet` is true
prefix	String	No	Prefix to prepend to each output line when `quiet` is false
prefixLog	Boolean	No	Uses `log` instead of `print` when applying the prefix (default is false)

Example:

include:
  - oJobBasics.yaml

jobs:
  # Example to show 123
  #
  - name: Example Echo 123
    to  : oJob sh
    args:
      cmd: echo 123

  # Example to show how you can combine multiple commands
  #
  - name: Example with multiple commands
    to  : oJob sh
    args:
      cmd:
        - echo -- [You are in `pwd`] -------------

        - >-
          echo -- [Previous directory] ----------- &&
          cd .. &&
          ls -1

        - >-
          echo -- [Current directory] ------------ &&
          cd . &&
          ls -1

  # Example to parse output
  #
  - name: Example to parse output
    from: oJob sh
    args:
      quiet: true
      cmd  : >-
         curl -X GET "https://httpbin.org/json" -H "accept: application/json"

    exec: |
      print("STDOUT   = " + stringify(jsonParse(args.stdout)));
      print("STDERR   = " + args.stderr);
      print("EXITCODE = " + args.exitcode);

  # Example to prepare cmd
  #
  - name: Example to prepare cmd
    to  : oJob sh
    exec: |
      args.cmd = "echo " + new Date();

todo:
  - Example Echo 123
  - Example with multiple commands
  - Example to parse output
  - Example to prepare cmd

oJob Stringify

Prints the result of a JavaScript expression as JSON.

Argument	Type	Mandatory	Description
name	String	Yes	JavaScript expression or object to evaluate and stringify
min	Boolean	No	If true, produces a minified JSON string

oJob Set

Assigns a value to a global variable.

Argument	Type	Mandatory	Description
name	String	Yes	Global variable name to assign
value	Any	No	Value to assign (defaults to `undefined`)

oJob Path Set

Assigns a value to a nested path of a global variable.

Argument	Type	Mandatory	Description
name	String	Yes	Global variable name to assign
path	String	No	Object path inside the global variable where the value should be stored
value	Any	No	Value to assign (defaults to `undefined`)

oJob YAML

Prints the result of a JavaScript expression as YAML.

Argument	Type	Mandatory	Description
name	String	Yes	JavaScript expression or object to evaluate and dump as YAML

oJob Sort Array

Sorts an array and stores the result in a global variable.

Argument	Type	Mandatory	Description
name	String	Yes	Destination global variable name
srcName	String	No	Source variable or expression to evaluate (defaults to `name`)
reverse	Boolean	No	If true, reverses the sorted array

oJob Map Array

Maps an array of objects into a new array using selectors.

Argument	Type	Mandatory	Description
name	String	Yes	Destination global variable name
srcName	String	Yes	Source variable or expression that resolves to an array
selectors	Array	No	Array of object path selectors to map (defaults to empty array)
limit	Number	No	Optional limit for the number of entries to process

oJob Map

Applies a $path/JMESPath expression to derive a new value.

Argument	Type	Mandatory	Description
name	String	Yes	Destination global variable name
srcName	String	Yes	Source variable or expression to evaluate
path	String	No	`$path`/JMESPath expression (defaults to empty string)

oJob Split into items

Splits a string from args into a list of maps stored in args._list.

Argument	Type	Mandatory	Description
source	String	Yes	Object path to the string source within `args`
separator	String	No	Separator used to split the string (defaults to newline)

oJob Print list

Prints the current list stored in args._list as YAML.

oJob Print args

Prints the current args map or a specific sub-path as YAML.

Argument	Type	Mandatory	Description
_path	String	No	Optional object path to print within `args`

oJob Get kept result

Retrieves a previously stored result created by oJob Keep result.

Argument	Type	Mandatory	Description
ojobkeep.name	String	No	Name of the stored result (defaults to `default`)
ojobkeep.keep	String	No	Optional object path to merge or assign from the kept result

Depending on the stored data type, the job will either merge maps into args or set args._list with the saved list.

oJob Keep result

Stores the current job output so it can be reused later with oJob Get kept result or oafGetResult.

Argument	Type	Mandatory	Description
ojobkeep.name	String	No	Name to associate with the stored result (defaults to `default`)
ojobkeep.keep	String	No	Optional object path inside `args` to store instead of the whole result

If args._list exists it will be persisted; otherwise the whole args map (or the provided path) is kept.

oJob Switch

Adds additional todo entries depending on the value of an argument.

Argument	Type	Mandatory	Description
switchOn	String	Yes	Argument name whose value determines the todo list
lowerCase	Boolean	No	If true, compares the value in lower case
todos	Map	Yes	Map of todo arrays keyed by possible argument values
default	Array	No	Todo array used when no matching key is found

oJob Sec Get

Retrieves secrets from an SBucket and maps them into args.

Argument	Type	Mandatory	Description
secOut	String	No	Destination path within `args` for the loaded secret
secKey	String	No	Key to retrieve from the SBucket (required unless `secIgnore` is true)
secRepo	String	No	Repository containing the SBucket
secBucket	String	No	SBucket name
secPass	String	No	Password for the SBucket
secMainPass	String	No	Repository password
secFile	String	No	Specific SBucket file to load
secDontAsk	Boolean	No	If true, avoids prompting for missing passwords
secIgnore	Boolean	No	If true, ignore missing secret parameters

oJob background processes

These jobs will run a command in background and wait for all to finish if needed. oJob Process Launch expects:

Argument	Type	Mandatory	Description
cmd	String/Array	Yes	The command to execute (or an array of commands) in background.
console	Boolean	No	Defines if stdout/stderr should be printed or not (defaults to true)
success	String	No	Code to execute as a function in case of success. Receives a "res" map from executing a sh function.
error	String	No	Code to execute as a function in case of error. Receives a "e" exception and a "cmd" with the original cmd argument.

Example:

include:
  - oJobBasics.yaml

todo:
  - Launch proc 1
  - Launch proc 2
  - oJob Process Wait

jobs:
  - name: Launch proc 1
    to  :
      - oJob Process Launch
    args:
      cmd    : "myProc1.sh"
      success: "log(stringify(res, void 0, ''));"

  - name: Launch proc 2
    to  :
      - oJob Process Launch
    args:
      cmd : "myProc2.sh"

oJob From global

This job will reset or merge a global variable map. Expects:

Argument	Type	Mandatory	Description
global	String	Yes	Load arguments from the global variable specified.

oJob Args from JSON

This job will load the args map from a JSON file. Expects:

Argument	Type	Mandatory	Description
file	String	Yes	The filepath to read the JSON file from.
global	String	No	Alternatively load to the global variable specified.

oJob Args from YAML

This job will load the args map from a YAML file. Expects:

Argument	Type	Mandatory	Description
file	String	Yes	The filepath to read the YAML file from.
global	String	No	Alternatively load to the global variable specified.

oJob Jobs Report

This job prints a job execution report on shutdown.

Argument	Type	Mandatory	Description
format	String	No	Output in json, yaml or table format (defaults to table)

Note: you can also use the job "oJob Jobs Final Report" to output the report on shutdown.

include:
  - oJobBasics.yaml

jobs:
  # some jobs

todo:
  - oJob Jobs Final Report
  # some todos

oJobEmail

oJobEmail jobs
oJob Send email

oJob Send email

This job tries to send an email. Expects:

Argument	Type	Mandatory	Description
server	String	Yes	The email server to use.
port	Number	No	The email server port to use.
from	String	Yes	The email from address.
to	Array	Yes	The email to addresses.
cc	Array	No	The email cc addresses.
bcc	Array	No	The email bcc addresses.
isHTML	Boolean	No	Specifies if the email is in HTML format.
subject	String	Yes	The email subject (a hbs template using args as data).
output	String	Yes	The email body message (a hbs template using args as data).
altOutput	String	No	The email body alternative message (defaults to message).
credentials	Map	No	The email server credentials (user and pass).
useSSL	Boolean	No	If the email server uses SSL.
useTLS	Boolean	No	If the email server uses TLS.
embedFiles	Array	No	Array of maps (with file and name) to embeded on the email.
addAttachments	Array	No	Array of maps (with file, isInLine, name) to attach on the email.
addImages	Array	No	Array of urls to images (only available if isHTML = true)-
embedURLs	Array	No	Array of maps (with url and name) to embeded on the email.
debug	Boolean	No	Determines if it should debug the process.

Example:

smtp-config.yaml

from       : [email protected]
server     : my.smtp.server
credentials:
  user: user1
  pass: pass1
useSSL     : true

sendEmail.yaml

include:
  - oJobEmail.yaml

jobs:
  - name: Send email test
    from: oJob Args from YAML
    to  : oJob Send email
    args:
      file   : smtp-config.yaml
      to     :
        - [email protected]
      subject: Test email
      output : My test email

todo:
  - Send email test

oJobSSH

SSH Exec

Executes commands on a SSH connection. The expected arguments are:

Argument	Type	Mandatory	Description
cmd	String/Array	Yes	A SSH command-line to execute or and array of it (keep in mind that this isn't bash)
stdin	String	No	An optional SSH stdin for the command-line to execute
chHosts	String	No	A channel with hosts configurations to use instead of individual config
host	String	No	The SSH host
port	Number	No	The SSH port (defaults to 22)
login	String	No	The SSH login
pass	String	No	The SSH pass
key	String	No	The path to a SSH key file (optional)
exitcode	Number	No	Determines what exitcode should be consider success (default is 0)
sudo	String	No	Sudo's to the corresponding user to executing the command-line
quiet	Boolean	No	Determines if no output of the command(s) execution should be provided (default to false)

Example:

hosts.yaml

- name : my host 1
  host : host1.local
  login: user1
  pass : pass1234
  key  : key.rsa

- name : my host 2
  host : host2.local
  login: user1
  pass : pass1234
  key  : key.rsa

example.yaml

include:
  - oJobSSH.yaml

ojob:
  sequential: true

jobs:
  # Example to show 123
  #
  - name: Example Echo 123
    deps:
      - SSH Load hosts
    to  : SSH Exec
    args:
      cmd: echo 123

  # Example to show how you can combine multiple commands
  #
  - name: Example with multiple commands
    deps:
      - SSH Load hosts
    to  : SSH Exec
    args:
      cmd:
        - echo -- [You are in `pwd`] -------------

        - >-
          echo -- [Previous directory] ----------- &&
          cd .. &&
          ls -1

        - >-
          echo -- [Current directory] ------------ &&
          cd . &&
          ls -1

  # Example to parse output
  #
  - name: Example to parse output
    deps:
      - SSH Load hosts
    from: SSH Exec
    args:
      quiet: true
      cmd  : >-
         curl -X GET "https://httpbin.org/json" -H "accept: application/json"

    exec: |
      print("STDOUT   = " + stringify(jsonParse(args.stdout)));
      print("STDERR   = " + args.stderr);
      print("EXITCODE = " + args.exitcode);

todo:
  - name: SSH Load hosts
    args:
      chHosts: myhosts
      file   : hosts.yaml
  
  - name: Example Echo 123
    args:
      chHosts: myhosts

  - name: Example with multiple commands
    args:
      chHosts: myhosts

  - name: Example to parse output
    args:
      chHosts: myhosts

oJobSQL

Allows for easy SQL query or executiong in any JDBC database.

Basic example:

consts:
  dbJDBC: &jdbcurl  jdbc:oracle:thin:@1.2.3.4:1521:ORCL
  dbUser: &jdbcuser scott
  dbPass: &jdbcpass tiger

include:
  - ojobSQL.yaml

jobs:
  ########################
  - name: Get current date
    from: SQL
    args:
      DBURL : *jdbcurl
      DBUser: *jdbcuser
      DBPass: *jdbcpass
      sql   : select current_date cd, sysdate sd from dual
    exec: |
      tprint("Current date = {{CD}}", args.output[0]);
      tprint("System date  = {{SD}}", args.output[0]);

  ##########################
  - name: Get generated data
    from: SQL RAID
    args:
      DBURL : *jdbcurl
      DBUser: *jdbcuser
      DBPass: *jdbcpass
      format : table
      sql    : |
        SELECT level, current_date, sysdate
        FROM   dual
        CONNECT BY level <= 10

todo:
  - Get current date
  - Get generated data

Example using RAID:

consts:
  raidURL: &raidurl http://user:[email protected]:1234/xdt
  raidDB : &raiddb  Dat

include:
  - ojobSQL.yaml

jobs:
  ########################
  - name: Get current date
    from: SQL RAID
    args:
      raidURL: *raidurl
      raidDB : *raiddb
      sql    : select current_date cd, sysdate sd from dual
    exec: |
      tprint("Current date = {{CD}}", args.output[0]);
      tprint("System date  = {{SD}}", args.output[0]);

  ##########################
  - name: Get generated data
    from: SQL RAID
    args:
      raidURL: *raidurl
      raidDB : *raiddb
      format : table
      sql    : |
        SELECT level, current_date, sysdate
        FROM   dual
        CONNECT BY level <= 10

todo:
  - Get current date
  - Get generated data

oJobES

Start Log to ES

Starts logging to ElasticSearch. Expects:

Argument	Type	Description
url	String	The ElasticSearch cluster URL
index	String	An ElasticSearch index name (it will be suffixed automatically with the current date)
format	String	The format of the date if different from day
host	String	A LogStash like host to identify in each entry
user	String	A user name
pass	String	A password (encrypted or not)

Example:

include:
  - oJobES.yaml

# [...]

# Log to ElasticSearch
todo:
  - name: Start Log to ES
    args:
      url  : http://my.es.cluster
      index: mylogs
      host : myjob

Example by week:

include:
  - oJobES.yaml

# [...]

# Log to ElasticSearch
todo:
  - name: Start Log to ES
    args:
      url   : http://my.es.cluster
      index : mylogs
      format: yyyy.ww
      host  : myjob

Stop ES Logging

Stops logging to ElasticSearch.

Example:

# Stop logging to ElasticSearch
todo:
  - Stop ES logging

oJobNet

tbc

oJobHTTPd

Simplifies the creation of one or more HTTP(s) server where you just provide which functions to run for each URI on a http(s) server. The function will receive all the requests parameters and return the content for the browser. If you wish to return JSON please check oJobRest.

It's composed of 3 jobs:

HTTP Start Server
HTTP Stop Server
HTTP Service
HTTP File Browse

The job "HTTP Start Server" expects:

Argument	Type	Mandatory	Description
port	Number	No	The port number where to assign the HTTP(s) server (defaults to 8091)
keystore	String	No	The keystore for the SSL certificates to create a HTTPS server
pass	String	No	The password for the keystore to create a HTTPS server
host	String	No	The ip address of the local network interface to which to bind this HTTP server (defaults to 0.0.0.0)
uriPrefix	String	No	Optionally a URI prefix to be applied to all routes
cp	String	No	Provide a folder where the keystore file is to include it on the current classpath (Java requires for keystores to be on the execution classpath)
hs	HTTPServer object	No	An already created HTTPServer to which to bind the HTTP services
mapLibs	Boolean	No	Map internal OpenAF libs like JQuery, highlight css, etc.

The job "HTTP Stop Server" expects:

Argument	Type	Mandatory	Description
port	Number	No	The port number where to assign the HTTP(s) server (defaults to 8091)

The job "HTTP service" expects:

Argument	Type	Mandatory	Description
port	Number	No	The port number where to assign the HTTP(s) server (defaults to 8091)
uri	String	No	The URI where the HTTP(s) service will be available.
execURI	String	Yes	The code to execute whenever the uri is requested. The code is included into a function that receives the arguments: request and server. "request" is a map containing all the request properties. "server" is the HTTPServer object for which you should use replyOKText, replyOKJSON, etc.

The job "HTTP File Browse" expects:

Argument	Type	Mandatory	Description
port	Number	No	The port number where to assign the HTTP(s) server (defaults to 8091)
uri	String	No	The URI where the HTTP(s) service will be available.
path	String	Yes	The canonical path to the file path that will be made available for browsing.
browse	String	No	If "false" no browsing interface will be included.

Example:

include:
  - oJobHTTPd.yaml

ojob:
  daemon: true

jobs:
  - name: Hello world
    to  : HTTP Service
    args:
      port   : 8080
      uri    : /
      execURI: return server.replyOKText("Hello world!");

  - name: Echo
    to  : HTTP Service
    args:
      port   : 8080
      uri    : /echo
      execURI: return server.replyOKJSON(stringify(request));
 
  - name: Browser
    to  : HTTP File Browse
    args:
      port: 8080
      uri : /browser
      path: .

  - name: README
    to  : HTTP Service
    args:
      port   : 8080
      uri    : /README
      execURI: return ow.server.httpd.replyFileMD(server, ".", "/README", request.uri, void 0, [ "README.md" ]); 

todo: 

  # Starts the server
  - name: HTTP Start Server
    args:
      port   : 8080
      mapLibs: true

  # Sets a shutdown job once the everything is stopped.
  - name: HTTP Stop Server 
    args:
      port: 8080
    
  # Sets for every URI to return Hello world
  - Hello world

  # Sets that /echo will return the actual request map
  - Echo

  # Sets that /README shows this README.md file
  - README

  # Sets that /browser shows a simple browse interface for the current directory.
  - Browser

oJobREST

In the same line as oJobHTTPd simplifies the specific creation of REST HTTP(s) servers.

It's composed of 3 jobs:

REST Start Server
REST Stop Server
REST Service

The job "REST Start Server" expects:

Argument	Type	Mandatory	Description
port	Number	No	The port number where to assign the HTTP(s) server (defaults to 8091)
keystore	String	No	The keystore for the SSL certificates to create a HTTPS server
pass	String	No	The password for the keystore to create a HTTPS server
host	String	No	The ip address of the local network interface to which to bind this HTTP server (defaults to 0.0.0.0)
cp	String	No	Provide a folder where the keystore file is to include it on the current classpath (Java requires for keystores to be on the execution classpath)
hs	HTTPServer object	No	An already created HTTPServer to which to bind the HTTP services
mapLibs	Boolean	No	Map internal OpenAF libs like JQuery, highlight css, etc.

The job "REST Stop Server" expects:

Argument	Type	Mandatory	Description
port	Number	No	The port number where to assign the HTTP(s) server (defaults to 8091)

The job "REST service" expects:

Argument	Type	Mandatory	Description
port	Number	No	The port number where to assign the HTTP(s) server (defaults to 8091)
uri	String	No	The URI where the HTTP(s) service will be available.
execGET	String	Yes	The code to execute whenever the uri is requested with a GET verb. The code is included into a function that receives the argument: idxs. "idxs" is a map containing all the parameters from the URL.
execPOST	String	Yes	The code to execute whenever the uri is requested with a POST verb. The code is included into a function that receives the arguments: idxs and data. "idxs" is a map containing all the parameters from the URL. "data" is a map containing all the parameters passed on the request body.
execPUT	String	Yes	The code to execute whenever the uri is requested with a PUT verb. The code is included into a function that receives the arguments: idxs and data. "idxs" is a map containing all the parameters from the URL. "data" is a map containing all the parameters passed on the request body.
execDELETE	String	Yes	The code to execute whenever the uri is requested with a DELETE verb. The code is included into a function that receives the argument: idxs. "idxs" is a map containing all the parameters from the URL.
returnWithParams	Boolean	No	Changes the behaviour of the return of each exec* function to use a map to force mimetype, http code, etc. (see help ow.server.rest.reply for more details)
error	Boolean	No	If true and an error occurs in execGET, execPOST, execPUT or execDELETE will return a map with the exception in a map with a key __error (defaults to true)

oJobOPack

Simplifies the creation of oPack files based on an url or oPack name.

The job "oPack Pack external" expects:

Argument	Type	Mandatory	Description
name	String	Yes	The name or URL to an oPack
tmpDir	String	No	The temporary folder to use during the process (defaults to ./tmp)
outputDir	String	No	Output folder where the oPack will be placed (defaults to .)

Example:

include:
  - oJobOPack.yaml

todo:
  - name: oPack Pack external
    args:
      - name  : https://raw.githubusercontent.com/OpenAF/nAttrMon/master
        tmpDir: nAttrMon

      - name  : APIs
        tmpDir: APIs

      - name  : GoogleCompiler
        tmpDir: GoogleCompiler
        
      - name  : GooglePhoneNumber
        tmpDir: GooglePhoneNumber

oJobRAID

Simplified RAID AF operation execution.

Expects:

Argument	Type	Mandatory	Description
raidURL	String	Yes	A RAID AF connection URL.
operation	String	Yes	The RAID AF operation to execute.
input	Map	No	The RAID AF operation input map.
format	String	No	If not quiet it displays the result on a format you can choose between "prettyprint" (default), "pmap", "parametermap", "yaml" or "json"
quiet	Boolean	No	If true no output will be displayed.

include:
  - oJobRAID.yaml

todo:
  - name: RAID AF
    args:
      raidURL  : http://user:[email protected]:8090/#/web/guest/home
      operation: Ping
      input    :
        test: 123
      format   : prettyprint

oJobWatchDog

Helps build a cron-based process "watchdog" for checking if a daemon process isn't running, has a "fatal" error on the log or any custom way to check the responsive of the daemon process.

Expects:

Argument	Type	Mandatory	Description
checks	Map	No	Map of checks to determine if the daemon process should be restarted or not.
checks.pid.file	String	No	If a pid file location is provided it will check if the corresponding pid is running. If not it sets to trigger a stop and start operation.
checks.log.folder	String	No	Folder where the log files to check are located.
checks.log.fileRE	String	No	Checks for files matching fileRE choosing the latest by modified date.
checks.log.stringRE	String	No	Array of regular expressions strings to look for. If found assumes a restart is needed.
checks.log.histFile	String	No	The file where to store the history of findings on the file to avoid duplicate findings.
checks.log.olderMin	Number	No	Checks if the latest log file (fileRE) by modified date is older than x minutes and if yes assumes it needs to be restarted.
checks.custom.exec	String	No	Executes the corresponding code in a function and passes if returns true or fails assuming a restart is needed if returns false.
quiet	Boolean	No	If true will only produce logging if something is not right (default is true)
cmdToStop	String	No	If defined will execute the command on the stop event.
execToStop	String	No	If defined will execute the code on the stop event.
jobToStop	String	No	If defined will execute the job on the stop event.
waitAfterStop	Number	No	Number of ms to wait after stopping.
workDirStop	String	No	The working directory to use for the stop command.
timeoutStop	Number	No	Timeout waiting for cmdToStop to exit.
exitCodeStop	Number	No	If defined the cmdToStop exitcode must be this value.
cmdToStart	String	No	Command to startup on the start event (make sure it exits after starting).
execToStart	String	No	If defined will execute the code on the start event.
jobToStart	String	No	If defined will execute the job on the start event.
waitAfterStart	Number	No	Number of ms to wait after starting.
workDirStart	String	No	The working directory to use for startup command.
timeoutStart	Number	No	Timeout waiting for cmdToStart to exit.
exitCodeStart	Number	No	If defined the cmdToStart exitcode must be this value.

Example:

include:
  - oJobWatchDog.yaml

ojob:
  logToFile   :
    logToFolder          : /some/path/watchdog.logs
    HKhowLongAgoInMinutes: 11152
    setLogOff            : false
  logToConsole: false
  logJobs     : false
  unique      :
    pidFile     : /some/path/watchdog.pid
    killPrevious: false
  checkStall  :
    everySeconds    : 1
    killAfterSeconds: 60

jobs:
  - name: Watch my logya daemon
    to  : oJob WatchDog
    args:
      checks  :
        pid:
          file: /some/path/a.pid
        log   :
          folder  : /some/path/logya
          fileRE  : log-\d+-\d+-\d+.log 
          histFile: /some/path/logya/logya.json
          stringRE: OutOfMemory
        custom:
          exec: |
            print(123);
            return false;

      cmdToStart    : start ojob /some/path/a.yaml
      workDirStart  : /some/path/
      waitAfterStart: 5000

      execToStop    : |
        pidKill(io.readFileString("/some/path/a.pid"), true);

      quiet         : false

todo:
  - nAttrMon watchdog

oJobMCP

Provides MCP (Model Context Protocol) server functionality for handling requests and executing jobs via HTTP or STDIO transport.

HTTP MCP Server

Starts a MCP server that listens for HTTP requests and executes jobs based on the requests.

Argument	Type	Mandatory	Description
port	Number	Yes	The port to listen on
uri	String	No	The URI to handle requests (defaults to "/mcp")
debug	Boolean	No	If true, debug messages will be logged (defaults to false)
description	Map	No	Metadata for the MCP server (protocol version, server info, capabilities)
fnsMeta	Map	No	Metadata for the functions available in the MCP server (defaults to {})
fns	Map	Yes	Functions/jobs to be executed when called from the MCP server

Example:

include:
  - oJobMCP.yaml

ojob:
  daemon: true

jobs:
  - name: ping
    exec: |
      args.text = "PONG!"

  - name: echo
    exec: |
      args.text = args.text

todo:
  - (httpdStart): 17878
  - (httpdMCP): 17878
    ((debug)): true
    ((uri)): "/mcp"
    ((fnsMeta)):
      - name: ping
        description: Pings the server
        inputSchema:
          type: object
          properties:
            text:
              type: string
              description: Text to return
          required: ["text"]
      - name: echo
        description: Echoes the input
        inputSchema:
          type: object
          properties:
            text:
              type: string
              description: Text to echo
          required: ["text"]
    ((fns)):
      ping: ping
      echo: echo

STDIO MCP Server

Starts a MCP stdio server to handle requests with execution of jobs.

Argument	Type	Mandatory	Description
debug	String	No	If defined, creates an ndjson file with the provided name for debugging
description	Map	No	Metadata for the MCP server (protocol version, server info, capabilities)
fnsMeta	Map	No	Metadata for the functions available in the MCP server (defaults to {})
fns	Map	Yes	Functions/jobs to be executed when called from the MCP server

oJobBrowse

Provides HTTP file browsing functionality with customizable templates and multiple rendering options.

HTTP Browse generic

Generic HTTP browse service with customizable templates and functions.

Argument	Type	Mandatory	Description
port	Number	No	The port where the server was made available (defaults to 8091)
uri	String	No	The URI where the HTTP Browse will be available (defaults to "/")
path	String	No	The base path for browsing (defaults to "")
templates	Map	No	Map with templates to be used
fns	Map	No	Map with functions for template rendering (getList, getObj, renderList, renderObj, renderEmpty, init)
options	Map	No	Map with options to be passed (browse, default, logo, showURI, sortTab, footer)

HTTP Browser

HTTP browser service based on existing types (e.g., ow.server.httpd.browse.files).

Argument	Type	Mandatory	Description
port	Number	No	The port where the server was made available (defaults to 8091)
uri	String	No	The URI where the HTTP Browser will be available (defaults to "/")
type	String	No	The type of HTTP Browser services (defaults to "files")
options	Map	No	Map with options to be passed to the browser type

oJobCh

Channel operations for buffering and managing data flow between channels.

oJob Ch Start Buffering

Creates a buffering channel between a source and a target channel.

Argument	Type	Mandatory	Description
source	String	Yes	The source channel name
target	String	Yes	The target channel name
id	String/Array	Yes	A string or array of fields that uniquely identify records
byNumber	Number	No	Limit number of records to buffer
byTimeInMs	Number	No	Limit time in ms to hold records in buffer
filterFunc	String	No	Function to filter what gets buffered
bufferFunc	String	No	Function to determine when to flush the buffer

Note: Use oJob Ch Stop Buffering to ensure proper release of resources.

oJob Ch Stop Buffering

Stops buffering between a source and a target channel.

Argument	Type	Mandatory	Description
source	String	Yes	The source channel name
target	String	Yes	The target channel name

oJob Ch Wait For Jobs

Waits for the jobs associated with a channel.

Argument	Type	Mandatory	Description
name	String	Yes	The channel name
timeout	Number	No	Optionally provide a timeout for the wait in ms

oJobIO

File I/O operations for manipulating files and directories.

IO Append File

Appends a line or lines to a file.

Argument	Type	Mandatory	Description
target	String	Yes	The text file to which the line will be appended
line	String/Array	Yes	The line(s) to be appended
separator	String	No	Separator (defaults to '\n')

IO Find & Replace

Finds and replaces text in a file using regular expressions.

Argument	Type	Mandatory	Description
target	String	Yes	The text file to be changed
search	String	Yes	The regular expression used for replacing
flags	String	No	Optional regular expression flags for search
replace	String	Yes	The replace text
separator	String	No	Separator (defaults to '\n')
byline	Boolean	No	Load entire file vs. line by line (defaults to true)

IO MV File

Moves a source to a target.

Argument	Type	Mandatory	Description
source	String	Yes	Source to move from
target	String	Yes	Target to move to

IO RM File

Removes a file or directory recursively.

Argument	Type	Mandatory	Description
filepath	String	Yes	The filepath (file or directory) to remove

IO CP File

Copies a source to a target.

Argument	Type	Mandatory	Description
source	String	Yes	Source to copy from
target	String	Yes	Target to copy to

IO List files

List files from a local filepath to args.files array.

Argument	Type	Mandatory	Description
path	String	Yes	The filepath to list files from
recursive	Boolean	No	Recursive file list (defaults to false)

IO List filenames

List filenames from a local filepath to args.files array.

Argument	Type	Mandatory	Description
path	String	Yes	The filepath to list files from
fullpath	Boolean	No	Include the fullpath with each file (defaults to true)

IO Modify text file

Finds and replaces text in a configuration file (exact match, not regex).

Argument	Type	Mandatory	Description
file	String	Yes	The file for find/replace
find	String	Yes	The string to find
replace	String	Yes	The string to replace

oJobTest

Testing functionality with assertions, test execution, and result reporting.

oJob Assert

Asserts that two values are equal.

Argument	Type	Mandatory	Description
a	Any	Yes	The 'a' value
b	Any	Yes	The 'b' value
msg	String	Yes	The message to display if the assert fails

oJob Test

Tests a function or job with optional asserts.

Argument	Type	Mandatory	Description
name	String	No	Test name (defaults to job name)
func	Function/String	No	The function to execute and test
job	String	No	The ojob to execute and test
count	Number	No	Number of test repeats (defaults to 1)
asserts	Array	No	Array of assert maps with 'path', 'value', and 'msg'
debug	Boolean	No	If true, outputs debug information

oJob Test sh

Tests a shell command.

Argument	Type	Mandatory	Description
name	String	No	Test name (defaults to job name)
cmd	String	Yes	The shell command to test

oJob Test Results

Prints or outputs test results with profile information.

Argument	Type	Mandatory	Description
quiet	Boolean	No	If true, won't output results to stdout (defaults to false)
noprofile	Boolean	No	If true, won't include profile results (defaults to false)
key	String	No	If defined, outputs results to the provided key

oJob Generate Markdown

Generates a Markdown document with test results.

Argument	Type	Mandatory	Description
key	String	No	If 'file' not defined, output to key and path
path	String	No	Path within key to store markdown output
file	String	No	If defined, outputs markdown to the provided file
includeLogs	Boolean	No	If true, includes logs in markdown (defaults to false)

oJob Generate JSON results

Generates JSON output with test results.

Argument	Type	Mandatory	Description
file	String	No	If defined, outputs JSON to file; "-" outputs to stdout
noprofile	Boolean	No	If true, won't include profile results (defaults to false)
includeLogs	Boolean	No	If true, includes logs (defaults to false)

oJob Generate JUnit XML

Generates JUnit XML format test results.

Argument	Type	Mandatory	Description
suitesId	String	Yes	The JUnit suites id
suitesName	String	Yes	The JUnit suites name
resultsFile	String	Yes	The filename and path where to store the JUnit results

oJobXLS

Excel file operations for creating and manipulating XLS/XLSX files.

oJob XLS Open File

Opens an XLSx file for use with other oJob XLS jobs.

Argument	Type	Mandatory	Description
file	String	Yes	The XLSx file to write to
template	String	No	The XLSx file to use as a template

oJob XLS Table

Adds an array of objects as a table on an XLS file sheet.

Argument	Type	Mandatory	Description
file	String	Yes	The XLSx file to write to
sheet	String	No	The sheet name or number (defaults to "table")
data	Array	Yes	The array of objects to add
position	Map	No	XLSx position with column and row (defaults to A1)
headerStyle	Object	No	Map of table header style options
lineStyle	Object	No	Map of table line style options
autoResize	Boolean	No	Auto-size columns (defaults to true)
autoFilter	Boolean	No	Enable auto filter (defaults to true)

oJob XLS Close File

Closes an XLSx file, writing it to the filesystem.

Argument	Type	Mandatory	Description
file	String	Yes	The XLSx file to write to

oJobGIT

GIT repository operations.

GIT Copy Repository

Copies a GIT repository files to a local folder.

Argument	Type	Mandatory	Description
gittarget	String	Yes	The target folder for repository files
giturl	String	Yes	The GIT repository URL
gittemp	String	No	Temporary folder to clone repository (defaults to gittarget + ".tmp")
gitbranch	String	No	Specific branch to checkout (defaults to master)
gituser	String	No	GIT remote repository user (can be encrypted)
gitpass	String	No	GIT remote repository pass (can be encrypted)

oJobDebug

Debug utilities for troubleshooting oJob execution.

oJob Debug Args

Logs the current args map for debugging purposes.

Shortcuts examples:

oJobTest.yaml

include:
- oJobTest.yaml

todo:
- (test      ): oJob::a
  ((job     )): a
- (test      ): oJob::b
  ((job     )): b
- (test      ): Script::Test
  ((func    )): |
    sleep(1500, true)
    ow.test.assert(1, 1, "Problem with assert in script test")
- (testAssert): Problem with a and b
  ((a       )): 123
  ((b       )): 124
- (testGenMD ): __
  ((file    )): results.md

jobs:
- name: a
  exec: |
    sleep(1500, true)

- name: b
  exec: |
    throw "MY error!"

oJobHTTPd.yaml

todo:
# Starts the server
- (httpdStart  ): &PORT 12345

# Setups the default answer, /healthz, /livez and /metrics
- (httpdDefault): *PORT
  ((uri       )): /
- (httpdHealthz): *PORT 
- (httpdMetrics): *PORT
  ((prefix    )): mytest

# Allows browsing of files
- (httpdFileBrowse): *PORT
  ((uri          )): /browse
  ((path         )): .

# Allows for the upload of files
- (httpdUpload): *PORT
  ((uri      )): /upload
  ((path     )): .

# Adds a custom metric
- (httpdAddMetric): global-counter
  ((fn          )): | 
    // Sets an atomic counter if one does not exist and returns a counter increment
    if (isUnDef(global.counter)) global.counter = $atomic()
    return global.counter.inc()

# /test calls the 'test' job
- (httpdService): *PORT
  ((uri       )): /test
  ((execURI   )): |
    // Shows all request components for debug
    cprint(request)
    // Returns the result of calling the job 'test' passing the request and expecting an ANSWER to be returned
    return ow.server.httpd.reply($job("test", request).ANSWER)

jobs:
# ---------------------------------
# Job test is written in shell code
- name: test
  lang: shell
  exec: |
    # Sets ANSWER in shell script
    ANSWER="Echo from the shell (a: {{params.a}})"

    # return ANSWER

# Includes the http server functionality
include:
- oJobHTTPd.yaml

# Makes sures it runs forever and oJob-common is included
ojob:
  daemon: true
  opacks:
    oJob-common

Name		Name	Last commit message	Last commit date
Latest commit History 399 Commits
.github		.github
.package.yaml		.package.yaml
LICENSE		LICENSE
README.md		README.md
oJobBasics.yaml		oJobBasics.yaml
oJobBrowse.yaml		oJobBrowse.yaml
oJobCh.yaml		oJobCh.yaml
oJobDebug.yaml		oJobDebug.yaml
oJobDirector.yaml		oJobDirector.yaml
oJobES.yaml		oJobES.yaml
oJobEmail.yaml		oJobEmail.yaml
oJobGIT.yaml		oJobGIT.yaml
oJobHBS.yaml		oJobHBS.yaml
oJobHTTPd.yaml		oJobHTTPd.yaml
oJobIO.yaml		oJobIO.yaml
oJobMCP.yaml		oJobMCP.yaml
oJobManager.yaml		oJobManager.yaml
oJobNet.yaml		oJobNet.yaml
oJobOPack.yaml		oJobOPack.yaml
oJobQueue.yaml		oJobQueue.yaml
oJobRAID.yaml		oJobRAID.yaml
oJobRest.yaml		oJobRest.yaml
oJobSQL.yaml		oJobSQL.yaml
oJobSSH.yaml		oJobSSH.yaml
oJobSVN.yaml		oJobSVN.yaml
oJobTest.yaml		oJobTest.yaml
oJobWatchDog.yaml		oJobWatchDog.yaml
oJobXLS.yaml		oJobXLS.yaml
oJobs.yaml		oJobs.yaml

License

OpenAF/oJob-common

Folders and files

Latest commit

History

Repository files navigation

oJob-common

oJobBasics

oJob Start and Stop helpers

oJob Sleep utilities

oJob sh

oJob Stringify

oJob Set

oJob Path Set

oJob YAML

oJob Sort Array

oJob Map Array

oJob Map

oJob Split into items

oJob Print list

oJob Print args

oJob Get kept result

oJob Keep result

oJob Switch

oJob Sec Get

oJob background processes

oJob From global

oJob Args from JSON

oJob Args from YAML

oJob Jobs Report

oJobEmail

oJob Send email

oJobSSH

SSH Exec

hosts.yaml

example.yaml

oJobSQL

oJobES

Start Log to ES

Stop ES Logging

oJobNet

oJobHTTPd

oJobREST

oJobOPack

oJobRAID

oJobWatchDog

oJobMCP

HTTP MCP Server

STDIO MCP Server

oJobBrowse

HTTP Browse generic

HTTP Browser

oJobCh

oJob Ch Start Buffering

oJob Ch Stop Buffering

oJob Ch Wait For Jobs

oJobIO

IO Append File

IO Find & Replace

IO MV File

IO RM File

IO CP File

IO List files

IO List filenames

IO Modify text file

oJobTest

oJob Assert

oJob Test

oJob Test sh

oJob Test Results

oJob Generate Markdown

oJob Generate JSON results

oJob Generate JUnit XML

oJobXLS

oJob XLS Open File

oJob XLS Table

oJob XLS Close File

oJobGIT

GIT Copy Repository

oJobDebug

Packages