Skip to content

Validation for CommandJobSchema failed: optional: unknown field #9298

@noraabiakar

Description

@noraabiakar

Describe the bug

This example from the docs doesn't work with the az ml CLI (azure-cli version: 2.78.0; ml extension version: 2.39.0).

The yaml:

$schema: https://azuremlschemas.azureedge.net/latest/commandComponent.schema.json
name: train_data_component_cli
display_name: train_data
description: A example train component
tags:
  author: azureml-sdk-team
type: command
inputs:
  training_data: 
    type: uri_folder
    optional: true
  learning_rate: 
    type: number
    default: 0.01
    optional: true
code: ./train_src
environment: azureml://registries/azureml/environments/sklearn-1.5/labels/latest
command: >-
  python train.py 
  $[[--training_data ${{inputs.training_data}}]]
  $[[--learning_rate ${{inputs.learning_rate}}]]

Related command

az ml job create --file .\test.yaml

Errors

The yaml file you provided does not match the prescribed schema for CommandJob yaml files and/or has the following issues:

Error: 
1) A least one unrecognized parameter is specified

Details: Validation for CommandSchema failed

(x) inputs:
- optional:
    - Unknown field.

Issue script & Debug output

cli.knack.cli: Command arguments: ['ml', 'job', 'create', '--file', '.\\test.yaml', '--debug']
cli.knack.cli: __init__ debug log:
Enable color in terminal.
cli.knack.cli: Event: Cli.PreExecute []
cli.knack.cli: Event: CommandParser.OnGlobalArgumentsCreate [<function CLILogging.on_global_arguments at 0x024695C8>, <function OutputProducer.on_global_arguments at 0x027BD118>, <function CLIQuery.on_global_arguments at 0x027DB2F8>]
cli.knack.cli: Event: CommandInvoker.OnPreCommandTableCreate []
cli.azure.cli.core: Modules found from index for 'ml': ['azext_mlv2']
cli.azure.cli.core: Loading command modules:
cli.azure.cli.core: Name                  Load Time    Groups  Commands
cli.azure.cli.core: Total (0)                 0.000         0         0
cli.azure.cli.core: These extensions are not installed and will be skipped: ['azext_ai_examples', 'azext_next']
cli.azure.cli.core: Loading extensions:
cli.azure.cli.core: Name                  Load Time    Groups  Commands  Directory
azure.ai.ml._azure_environments: Using the default cloud configuration: 'AzureCloud'.
azure.ai.ml._azure_environments: Using the default cloud configuration: 'AzureCloud'.
azure.ai.ml._azure_environments: Using the default cloud configuration: 'AzureCloud'.
cli.azure.cli.core: ml                        4.980        25       165  C:\Users\noraabiakar\.azure\cliextensions\ml
cli.azure.cli.core: Total (1)                 4.980        25       165  
cli.azure.cli.core: Loaded 25 groups, 165 commands.
cli.azure.cli.core: Found a match in the command table.
cli.azure.cli.core: Raw command  : ml job create
cli.azure.cli.core: Command table: ml job create
cli.knack.cli: Event: CommandInvoker.OnPreCommandTableTruncate [<function AzCliLogging.init_command_file_logging at 0x045A8028>]
cli.azure.cli.core.azlogging: metadata file logging enabled - writing logs to 'C:\Users\noraabiakar\.azure\commands\2025-10-14.10-29-32.ml_job_create.23684.log'.
az_command_data_logger: command args: ml job create --file {} --debug
cli.knack.cli: Event: CommandInvoker.OnPreArgumentLoad [<function register_global_subscription_argument.<locals>.add_subscription_parameter at 0x045E0398>]
cli.knack.commands: Configured default 'rg-omniverseaipipeline-app-dev-eu2-001' for arg resource_group_name
cli.knack.commands: Configured default 'mlw-aml-dev-eu2-001' for arg workspace_name
cli.knack.cli: Event: CommandInvoker.OnPostArgumentLoad []
cli.knack.cli: Event: CommandInvoker.OnPostCommandTableCreate [<function register_ids_argument.<locals>.add_ids_arguments at 0x045E07A8>, <function register_cache_arguments.<locals>.add_cache_arguments at 0x04612AC8>, <function register_upcoming_breaking_change_info.<locals>.update_breaking_change_info at 0x04612B18>] 
cli.knack.cli: Event: CommandInvoker.OnCommandTableLoaded []
cli.knack.cli: Event: CommandInvoker.OnPreParseArgs []
cli.knack.cli: Event: CommandInvoker.OnPostParseArgs [<function OutputProducer.handle_output_argument at 0x027BD168>, <function CLIQuery.handle_query_parameter at 0x027DB348>, <function register_ids_argument.<locals>.parse_ids_arguments at 0x04612A28>]
az_command_data_logger: extension name: ml
az_command_data_logger: extension version: 2.39.0
cli.azure.cli.core.commands.client_factory: Getting management service client client_type=AzureMachineLearningWorkspaces
cli.azure.cli.core.auth.persistence: build_persistence: location='C:\\Users\\noraabiakar\\.azure\\msal_token_cache.bin', encrypt=True
cli.azure.cli.core.auth.binary_cache: load: C:\Users\noraabiakar\.azure\msal_http_cache.bin
urllib3.util.retry: Converted retries value: 1 -> Retry(total=1, connect=None, read=None, redirect=None, status=None)
msal.authority: Initializing with Entra authority: https://login.microsoftonline.com/5a5c4bcf-d285-44af-8f19-ca72d454f6f7
msal.authority: openid_config("https://login.microsoftonline.com/5a5c4bcf-d285-44af-8f19-ca72d454f6f7/v2.0/.well-known/openid-configuration") = {'token_endpoint': 'https://login.microsoftonline.com/5a5c4bcf-d285-44af-8f19-ca72d454f6f7/oauth2/v2.0/token', 'token_endpoint_auth_methods_supported': ['client_secret_post', 'private_key_jwt', 'client_secret_basic'], 'jwks_uri': 'https://login.microsoftonline.com/5a5c4bcf-d285-44af-8f19-ca72d454f6f7/discovery/v2.0/keys', 'response_modes_supported': ['query', 'fragment', 'form_post'], 'subject_types_supported': ['pairwise'], 'id_token_signing_alg_values_supported': ['RS256'], 'response_types_supported': ['code', 'id_token', 'code id_token', 'id_token token'], 'scopes_supported': ['openid', 'profile', 'email', 'offline_access'], 'issuer': 'https://login.microsoftonline.com/5a5c4bcf-d285-44af-8f19-ca72d454f6f7/v2.0', 'request_uri_parameter_supported': False, 'userinfo_endpoint': 'https://graph.microsoft.com/oidc/userinfo', 'authorization_endpoint': 'https://login.microsoftonline.com/5a5c4bcf-d285-44af-8f19-ca72d454f6f7/oauth2/v2.0/authorize', 'device_authorization_endpoint': 'https://login.microsoftonline.com/5a5c4bcf-d285-44af-8f19-ca72d454f6f7/oauth2/v2.0/devicecode', 'http_logout_supported': True, 'frontchannel_logout_supported': True, 'end_session_endpoint': 'https://login.microsoftonline.com/5a5c4bcf-d285-44af-8f19-ca72d454f6f7/oauth2/v2.0/logout', 'claims_supported': ['sub', 'iss', 'cloud_instance_name', 'cloud_instance_host_name', 'cloud_graph_host_name', 'msgraph_host', 'aud', 'exp', 'iat', 'auth_time', 'acr', 'nonce', 'preferred_username', 'name', 'tid', 'ver', 'at_hash', 'c_hash', 'email'], 'kerberos_endpoint': 'https://login.microsoftonline.com/5a5c4bcf-d285-44af-8f19-ca72d454f6f7/kerberos', 'tenant_region_scope': 'EU', 'cloud_instance_name': 'microsoftonline.com', 'cloud_graph_host_name': 'graph.windows.net', 'msgraph_host': 'graph.microsoft.com', 'rbac_url': 'https://pas.windows.net'}
msal.application: Broker enabled? True
cli.azure.cli.core.commands.client_factory: Getting management service client client_type=_ml_client_cli
urllib3.util.retry: Converted retries value: 1 -> Retry(total=1, connect=None, read=None, redirect=None, status=None)
msal.authority: Initializing with Entra authority: https://login.microsoftonline.com/5a5c4bcf-d285-44af-8f19-ca72d454f6f7
msal.authority: openid_config("https://login.microsoftonline.com/5a5c4bcf-d285-44af-8f19-ca72d454f6f7/v2.0/.well-known/openid-configuration") = {'token_endpoint': 'https://login.microsoftonline.com/5a5c4bcf-d285-44af-8f19-ca72d454f6f7/oauth2/v2.0/token', 'token_endpoint_auth_methods_supported': ['client_secret_post', 'private_key_jwt', 'client_secret_basic'], 'jwks_uri': 'https://login.microsoftonline.com/5a5c4bcf-d285-44af-8f19-ca72d454f6f7/discovery/v2.0/keys', 'response_modes_supported': ['query', 'fragment', 'form_post'], 'subject_types_supported': ['pairwise'], 'id_token_signing_alg_values_supported': ['RS256'], 'response_types_supported': ['code', 'id_token', 'code id_token', 'id_token token'], 'scopes_supported': ['openid', 'profile', 'email', 'offline_access'], 'issuer': 'https://login.microsoftonline.com/5a5c4bcf-d285-44af-8f19-ca72d454f6f7/v2.0', 'request_uri_parameter_supported': False, 'userinfo_endpoint': 'https://graph.microsoft.com/oidc/userinfo', 'authorization_endpoint': 'https://login.microsoftonline.com/5a5c4bcf-d285-44af-8f19-ca72d454f6f7/oauth2/v2.0/authorize', 'device_authorization_endpoint': 'https://login.microsoftonline.com/5a5c4bcf-d285-44af-8f19-ca72d454f6f7/oauth2/v2.0/devicecode', 'http_logout_supported': True, 'frontchannel_logout_supported': True, 'end_session_endpoint': 'https://login.microsoftonline.com/5a5c4bcf-d285-44af-8f19-ca72d454f6f7/oauth2/v2.0/logout', 'claims_supported': ['sub', 'iss', 'cloud_instance_name', 'cloud_instance_host_name', 'cloud_graph_host_name', 'msgraph_host', 'aud', 'exp', 'iat', 'auth_time', 'acr', 'nonce', 'preferred_username', 'name', 'tid', 'ver', 'at_hash', 'c_hash', 'email'], 'kerberos_endpoint': 'https://login.microsoftonline.com/5a5c4bcf-d285-44af-8f19-ca72d454f6f7/kerberos', 'tenant_region_scope': 'EU', 'cloud_instance_name': 'microsoftonline.com', 'cloud_graph_host_name': 'graph.windows.net', 'msgraph_host': 'graph.microsoft.com', 'rbac_url': 'https://pas.windows.net'}
msal.application: Broker enabled? True
Class AutoDeleteSettingSchema: This is an experimental class, and may change at any time. Please see https://aka.ms/azuremlexperimental for more information.
Class AutoDeleteConditionSchema: This is an experimental class, and may change at any time. Please see https://aka.ms/azuremlexperimental for more information.
Class BaseAutoDeleteSettingSchema: This is an experimental class, and may change at any time. Please see https://aka.ms/azuremlexperimental for more information.
Class IntellectualPropertySchema: This is an experimental class, and may change at any time. Please see https://aka.ms/azuremlexperimental for more information.
Class ProtectionLevelSchema: This is an experimental class, and may change at any time. Please see https://aka.ms/azuremlexperimental for more information.
Class BaseIntellectualPropertySchema: This is an experimental class, and may change at any time. Please see https://aka.ms/azuremlexperimental for more information.
Traceback (most recent call last):
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azure\ai\ml\entities\_util.py", line 192, in load_from_dict
    return schema(context=context).load(data, **kwargs)
           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\marshmallow\schema.py", line 792, in load
    return self._do_load(
           ~~~~~~~~~~~~~^
        data, many=many, partial=partial, unknown=unknown, postprocess=True
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    )
    ^
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\marshmallow\schema.py", line 999, in _do_load
    raise exc
marshmallow.exceptions.ValidationError: {'inputs': defaultdict(<class 'dict'>, {'training_data': {'value': [{'optional': ['Unknown field.']}, {'type': ["Value 'uri_folder' passed is not in set ['custom_model', 'mlflow_model', 'triton_model']"], 'optional': ['Unknown field.']}, {'type': ["Value 'uri_folder' passed is not in set ['mltable']"], 'optional': ['Unknown field.']}, {'optional': ['Unknown field.'], 'type': ['Unknown field.']}, {None: [{'_schema': ['Not a valid integer.']}, {'_schema': ['Not a valid number.']}, {'_schema': ['Not a valid string.']}, {'_schema': ['Not a valid boolean.']}]}]}, 'learning_rate': {'value': [{'type': ["Value 'number' passed is not in set ['uri_file', 'uri_folder']"], 'optional': ['Unknown field.'], 'default': ['Unknown field.']}, {'type': ["Value 'number' passed is not in set ['custom_model', 'mlflow_model', 'triton_model']"], 'optional': ['Unknown field.'], 'default': ['Unknown field.']}, {'type': ["Value 'number' passed is not in set ['mltable']"], 'optional': ['Unknown field.'], 'default': ['Unknown field.']}, {'optional': ['Unknown field.'], 'type': ['Unknown field.'], 'default': ['Unknown field.']}, {None: [{'_schema': ['Not a valid integer.']}, {'_schema': ['Not a valid number.']}, {'_schema': ['Not a valid string.']}, {'_schema': ['Not a valid boolean.']}]}]}})}

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azure\ai\ml\entities\_load_functions.py", line 106, in load_common
    return _load_common_raising_marshmallow_error(cls, yaml_dict, relative_origin, params_override, **kwargs)
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azure\ai\ml\entities\_load_functions.py", line 166, in _load_common_raising_marshmallow_error
    res: Resource = cls._load(data=yaml_dict, yaml_path=relative_origin, params_override=params_override, **kwargs)
                    ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azure\ai\ml\entities\_job\job.py", line 276, in _load
    job: Job = job_type._load_from_dict(
               ~~~~~~~~~~~~~~~~~~~~~~~~^
        data=data,
        ^^^^^^^^^^
    ...<3 lines>...
        **kwargs,
        ^^^^^^^^^
    )
    ^
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azure\ai\ml\entities\_builders\command.py", line 805, in _load_from_dict
    loaded_data = load_from_dict(CommandJobSchema, data, context, additional_message, **kwargs)
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azure\ai\ml\entities\_util.py", line 195, in load_from_dict
    raise ValidationError(decorate_validation_error(schema, pretty_error, additional_message)) from e
marshmallow.exceptions.ValidationError: Validation for CommandJobSchema failed:

 {
  "inputs": {
    "training_data": {
      "value": [
        {
          "optional": [
            "Unknown field."
          ]
        },
        {
          "type": [
            "Value 'uri_folder' passed is not in set ['custom_model', 'mlflow_model', 'triton_model']"
          ],
          "optional": [
            "Unknown field."
          ]
        },
        {
          "type": [
            "Value 'uri_folder' passed is not in set ['mltable']"
          ],
          "optional": [
            "Unknown field."
          ]
        },
        {
          "optional": [
            "Unknown field."
          ],
          "type": [
            "Unknown field."
          ]
        },
        {
          "null": [
            {
              "_schema": [
                "Not a valid integer."
              ]
            },
            {
              "_schema": [
                "Not a valid number."
              ]
            },
            {
              "_schema": [
                "Not a valid string."
              ]
            },
            {
              "_schema": [
                "Not a valid boolean."
              ]
            }
          ]
        }
      ]
    },
    "learning_rate": {
      "value": [
        {
          "type": [
            "Value 'number' passed is not in set ['uri_file', 'uri_folder']"
          ],
          "optional": [
            "Unknown field."
          ],
          "default": [
            "Unknown field."
          ]
        },
        {
          "type": [
            "Value 'number' passed is not in set ['custom_model', 'mlflow_model', 'triton_model']"
          ],
          "optional": [
            "Unknown field."
          ],
          "default": [
            "Unknown field."
          ]
        },
        {
          "type": [
            "Value 'number' passed is not in set ['mltable']"
          ],
          "optional": [
            "Unknown field."
          ],
          "default": [
            "Unknown field."
          ]
        },
        {
          "optional": [
            "Unknown field."
          ],
          "type": [
            "Unknown field."
          ],
          "default": [
            "Unknown field."
          ]
        },
        {
          "null": [
            {
              "_schema": [
                "Not a valid integer."
              ]
            },
            {
              "_schema": [
                "Not a valid number."
              ]
            },
            {
              "_schema": [
                "Not a valid string."
              ]
            },
            {
              "_schema": [
                "Not a valid boolean."
              ]
            }
          ]
        }
      ]
    }
  }
}

 If you are trying to configure a job that is not of type command, please specify the correct job type in the 'type' property.

Visit this link to refer to the CommandJob schema if needed: https://aka.ms/ml-cli-v2-job-command-yaml-reference.
The easiest way to author a specification file is using IntelliSense and auto-completion Azure ML VS code extension provides: https://code.visualstudio.com/docs/datascience/azure-machine-learning. To set up: https://learn.microsoft.com/azure/machine-learning/how-to-setup-vs-code

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azext_mlv2\manual\custom\job.py", line 86, in ml_job_create
    job = load_job(source=file, params_override=params_override)
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azure\ai\ml\entities\_load_functions.py", line 233, in load_job
    return cast(Job, load_common(Job, source, relative_origin, params_override, **kwargs))
                     ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azure\ai\ml\entities\_load_functions.py", line 131, in load_common
    validation_result.try_raise(error_func=build_error)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azure\ai\ml\entities\_validation\core.py", line 253, in try_raise
    raise error_func(
    ...<2 lines>...
    )
marshmallow.exceptions.ValidationError: Validation for CommandSchema failed:

 {
  "result": "Failed",
  "errors": [
    {
      "message": "Validation for CommandJobSchema failed:\n\n {\n  \"inputs\": {\n    \"training_data\": {\n      \"value\": [\n        {\n          \"optional\": [\n            \"Unknown field.\"\n          ]\n        },\n        {\n          \"type\": [\n            \"Value 'uri_folder' passed is not in set ['custom_model', 'mlflow_model', 'triton_model']\"\n          ],\n          \"optional\": [\n            \"Unknown field.\"\n          ]\n        },\n        {\n          \"type\": [\n            \"Value 'uri_folder' passed is not in set ['mltable']\"\n          ],\n          \"optional\": [\n            \"Unknown field.\"\n          ]\n        },\n        {\n          \"optional\": [\n            \"Unknown field.\"\n          ],\n          \"type\": [\n            \"Unknown field.\"\n          ]\n        },\n        {\n          \"null\": [\n            {\n              \"_schema\": [\n                \"Not a valid integer.\"\n             
 ]\n            },\n            {\n              \"_schema\": [\n                \"Not a valid number.\"\n              ]\n            },\n            {\n              \"_schema\": [\n                \"Not a valid string.\"\n              ]\n            },\n            {\n              \"_schema\": [\n                \"Not a valid boolean.\"\n              ]\n            }\n          ]\n        }\n      ]\n    },\n    \"learning_rate\": {\n      \"value\": [\n        {\n          \"type\": [\n            \"Value 'number' passed is not in set ['uri_file', 'uri_folder']\"\n          ],\n          \"optional\": [\n            \"Unknown field.\"\n          ],\n          \"default\": [\n            \"Unknown field.\"\n          ]\n        },\n        {\n          \"type\": [\n            \"Value 'number' passed is not in set ['custom_model', 'mlflow_model', 'triton_model']\"\n          ],\n          \"optional\": [\n            \"Unknown field.\"\n          ],\n          \"default\": [\n            \"Unknown field.\"\n          ]\n        },\n        {\n          \"type\": [\n            \"Value 'number' passed is not in set ['mltable']\"\n          ],\n          \"optional\": [\n            \"Unknown field.\"\n          ],\n          \"default\": [\n            \"Unknown field.\"\n          ]\n        },\n        {\n          \"optional\": [\n            \"Unknown field.\"\n          ],\n          \"type\": [\n          
  \"Unknown field.\"\n          ],\n          \"default\": [\n            \"Unknown field.\"\n          ]\n        },\n        {\n          \"null\": [\n            {\n              \"_schema\": [\n                \"Not a valid integer.\"\n              ]\n            },\n            {\n              \"_schema\": [\n                \"Not a valid number.\"\n              ]\n            },\n            {\n              \"_schema\": [\n                \"Not a valid string.\"\n              ]\n            },\n            {\n              \"_schema\": [\n                \"Not a valid boolean.\"\n              ]\n            }\n          
]\n        }\n      ]\n    }\n  }\n} \n\n If you are trying to configure a job that is not of type command, please specify the correct job type in the 'type' property.\n\nVisit this link to refer to the CommandJob schema if needed: https://aka.ms/ml-cli-v2-job-command-yaml-reference.\nThe easiest way to author a specification file is using IntelliSense and auto-completion Azure ML VS code extension provides: https://code.visualstudio.com/docs/datascience/azure-machine-learning. To set up: https://learn.microsoft.com/azure/machine-learning/how-to-setup-vs-code",
      "path": "*",
      "value": null,
      "location": ".\\test.yaml"
    }
  ]
}

 If you are trying to configure an entity that is not of type command, please specify the correct type in the 'type' property.
The easiest way to author a specification file is using IntelliSense and auto-completion Azure ML VS code extension provides: https://code.visualstudio.com/docs/datascience/azure-machine-learning. To set up: https://learn.microsoft.com/azure/machine-learning/how-to-setup-vs-code
cli: None
cli: Traceback (most recent call last):
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azure\ai\ml\entities\_util.py", line 192, in load_from_dict
    return schema(context=context).load(data, **kwargs)
           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\marshmallow\schema.py", line 792, in load
    return self._do_load(
           ~~~~~~~~~~~~~^
        data, many=many, partial=partial, unknown=unknown, postprocess=True
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    )
    ^
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\marshmallow\schema.py", line 999, in _do_load
    raise exc
marshmallow.exceptions.ValidationError: {'inputs': defaultdict(<class 'dict'>, {'training_data': {'value': [{'optional': ['Unknown field.']}, {'type': ["Value 'uri_folder' passed is not in set ['custom_model', 'mlflow_model', 'triton_model']"], 'optional': ['Unknown field.']}, {'type': ["Value 'uri_folder' passed is not in set ['mltable']"], 'optional': ['Unknown field.']}, {'optional': ['Unknown field.'], 'type': ['Unknown field.']}, {None: [{'_schema': ['Not a valid integer.']}, {'_schema': ['Not a valid number.']}, {'_schema': ['Not a valid string.']}, {'_schema': ['Not a valid boolean.']}]}]}, 'learning_rate': {'value': [{'type': ["Value 'number' passed is not in set ['uri_file', 'uri_folder']"], 'optional': ['Unknown field.'], 'default': ['Unknown field.']}, {'type': ["Value 'number' passed is not in set ['custom_model', 'mlflow_model', 'triton_model']"], 'optional': ['Unknown field.'], 'default': ['Unknown field.']}, {'type': ["Value 'number' passed is not in set ['mltable']"], 'optional': ['Unknown field.'], 'default': ['Unknown field.']}, {'optional': ['Unknown field.'], 'type': ['Unknown field.'], 'default': ['Unknown field.']}, {None: [{'_schema': ['Not a valid integer.']}, {'_schema': ['Not a valid number.']}, {'_schema': ['Not a valid string.']}, {'_schema': ['Not a valid boolean.']}]}]}})}

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azure\ai\ml\entities\_load_functions.py", line 106, in load_common
    return _load_common_raising_marshmallow_error(cls, yaml_dict, relative_origin, params_override, **kwargs)
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azure\ai\ml\entities\_load_functions.py", line 166, in _load_common_raising_marshmallow_error
    res: Resource = cls._load(data=yaml_dict, yaml_path=relative_origin, params_override=params_override, **kwargs)
                    ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azure\ai\ml\entities\_job\job.py", line 276, in _load
    job: Job = job_type._load_from_dict(
               ~~~~~~~~~~~~~~~~~~~~~~~~^
        data=data,
        ^^^^^^^^^^
    ...<3 lines>...
        **kwargs,
        ^^^^^^^^^
    )
    ^
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azure\ai\ml\entities\_builders\command.py", line 805, in _load_from_dict
    loaded_data = load_from_dict(CommandJobSchema, data, context, additional_message, **kwargs)
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azure\ai\ml\entities\_util.py", line 195, in load_from_dict
    raise ValidationError(decorate_validation_error(schema, pretty_error, additional_message)) from e
marshmallow.exceptions.ValidationError: Validation for CommandJobSchema failed:

 {
  "inputs": {
    "training_data": {
      "value": [
        {
          "optional": [
            "Unknown field."
          ]
        },
        {
          "type": [
            "Value 'uri_folder' passed is not in set ['custom_model', 'mlflow_model', 'triton_model']"
          ],
          "optional": [
            "Unknown field."
          ]
        },
        {
          "type": [
            "Value 'uri_folder' passed is not in set ['mltable']"
          ],
          "optional": [
            "Unknown field."
          ]
        },
        {
          "optional": [
            "Unknown field."
          ],
          "type": [
            "Unknown field."
          ]
        },
        {
          "null": [
            {
              "_schema": [
                "Not a valid integer."
              ]
            },
            {
              "_schema": [
                "Not a valid number."
              ]
            },
            {
              "_schema": [
                "Not a valid string."
              ]
            },
            {
              "_schema": [
                "Not a valid boolean."
              ]
            }
          ]
        }
      ]
    },
    "learning_rate": {
      "value": [
        {
          "type": [
            "Value 'number' passed is not in set ['uri_file', 'uri_folder']"
          ],
          "optional": [
            "Unknown field."
          ],
          "default": [
            "Unknown field."
          ]
        },
        {
          "type": [
            "Value 'number' passed is not in set ['custom_model', 'mlflow_model', 'triton_model']"
          ],
          "optional": [
            "Unknown field."
          ],
          "default": [
            "Unknown field."
          ]
        },
        {
          "type": [
            "Value 'number' passed is not in set ['mltable']"
          ],
          "optional": [
            "Unknown field."
          ],
          "default": [
            "Unknown field."
          ]
        },
        {
          "optional": [
            "Unknown field."
          ],
          "type": [
            "Unknown field."
          ],
          "default": [
            "Unknown field."
          ]
        },
        {
          "null": [
            {
              "_schema": [
                "Not a valid integer."
              ]
            },
            {
              "_schema": [
                "Not a valid number."
              ]
            },
            {
              "_schema": [
                "Not a valid string."
              ]
            },
            {
              "_schema": [
                "Not a valid boolean."
              ]
            }
          ]
        }
      ]
    }
  }
}

 If you are trying to configure a job that is not of type command, please specify the correct job type in the 'type' property.

Visit this link to refer to the CommandJob schema if needed: https://aka.ms/ml-cli-v2-job-command-yaml-reference.
The easiest way to author a specification file is using IntelliSense and auto-completion Azure ML VS code extension provides: https://code.visualstudio.com/docs/datascience/azure-machine-learning. To set up: https://learn.microsoft.com/azure/machine-learning/how-to-setup-vs-code

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azext_mlv2\manual\custom\job.py", line 86, in ml_job_create
    job = load_job(source=file, params_override=params_override)
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azure\ai\ml\entities\_load_functions.py", line 233, in load_job
    return cast(Job, load_common(Job, source, relative_origin, params_override, **kwargs))
                     ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azure\ai\ml\entities\_load_functions.py", line 131, in load_common
    validation_result.try_raise(error_func=build_error)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azure\ai\ml\entities\_validation\core.py", line 253, in try_raise
    raise error_func(
    ...<2 lines>...
    )
marshmallow.exceptions.ValidationError: Validation for CommandSchema failed:

 {
  "result": "Failed",
  "errors": [
    {
      "message": "Validation for CommandJobSchema failed:\n\n {\n  \"inputs\": {\n    \"training_data\": {\n      \"value\": [\n        {\n          \"optional\": [\n            \"Unknown field.\"\n          ]\n        },\n        {\n          \"type\": [\n            \"Value 'uri_folder' passed is not in set ['custom_model', 'mlflow_model', 'triton_model']\"\n          ],\n          \"optional\": [\n            \"Unknown field.\"\n          ]\n        },\n        {\n          \"type\": [\n            \"Value 'uri_folder' passed is not in set ['mltable']\"\n          ],\n          \"optional\": [\n            \"Unknown field.\"\n          ]\n        },\n        {\n          \"optional\": [\n            \"Unknown field.\"\n          ],\n          \"type\": [\n            \"Unknown field.\"\n          ]\n        },\n        {\n          \"null\": [\n            {\n              \"_schema\": [\n                \"Not a valid integer.\"\n             
 ]\n            },\n            {\n              \"_schema\": [\n                \"Not a valid number.\"\n              ]\n            },\n            {\n              \"_schema\": [\n                \"Not a valid string.\"\n              ]\n            },\n            {\n              \"_schema\": [\n                \"Not a valid boolean.\"\n              ]\n            }\n          ]\n        }\n      ]\n    },\n    \"learning_rate\": {\n      \"value\": [\n        {\n          \"type\": [\n            \"Value 'number' passed is not in set ['uri_file', 'uri_folder']\"\n          ],\n          \"optional\": [\n            \"Unknown field.\"\n          ],\n          \"default\": [\n            \"Unknown field.\"\n          ]\n        },\n        {\n          \"type\": [\n            \"Value 'number' passed is not in set ['custom_model', 'mlflow_model', 'triton_model']\"\n          ],\n          \"optional\": [\n            \"Unknown field.\"\n          ],\n          \"default\": [\n            \"Unknown field.\"\n          ]\n        },\n        {\n          \"type\": [\n            \"Value 'number' passed is not in set ['mltable']\"\n          ],\n          \"optional\": [\n            \"Unknown field.\"\n          ],\n          \"default\": [\n            \"Unknown field.\"\n          ]\n        },\n        {\n          \"optional\": [\n            \"Unknown field.\"\n          ],\n          \"type\": [\n          
  \"Unknown field.\"\n          ],\n          \"default\": [\n            \"Unknown field.\"\n          ]\n        },\n        {\n          \"null\": [\n            {\n              \"_schema\": [\n                \"Not a valid integer.\"\n              ]\n            },\n            {\n              \"_schema\": [\n                \"Not a valid number.\"\n              ]\n            },\n            {\n              \"_schema\": [\n                \"Not a valid string.\"\n              ]\n            },\n            {\n              \"_schema\": [\n                \"Not a valid boolean.\"\n              ]\n            }\n          
]\n        }\n      ]\n    }\n  }\n} \n\n If you are trying to configure a job that is not of type command, please specify the correct job type in the 'type' property.\n\nVisit this link to refer to the CommandJob schema if needed: https://aka.ms/ml-cli-v2-job-command-yaml-reference.\nThe easiest way to author a specification file is using IntelliSense and auto-completion Azure ML VS code extension provides: https://code.visualstudio.com/docs/datascience/azure-machine-learning. To set up: https://learn.microsoft.com/azure/machine-learning/how-to-setup-vs-code",
      "path": "*",
      "value": null,
      "location": ".\\test.yaml"
    }
  ]
}

 If you are trying to configure an entity that is not of type command, please specify the correct type in the 'type' property.
The easiest way to author a specification file is using IntelliSense and auto-completion Azure ML VS code extension provides: https://code.visualstudio.com/docs/datascience/azure-machine-learning. To set up: https://learn.microsoft.com/azure/machine-learning/how-to-setup-vs-code

cli.azure.cli.core.azclierror: Traceback (most recent call last):
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azure\ai\ml\entities\_util.py", line 192, in load_from_dict
    return schema(context=context).load(data, **kwargs)
           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\marshmallow\schema.py", line 792, in load
    return self._do_load(
           ~~~~~~~~~~~~~^
        data, many=many, partial=partial, unknown=unknown, postprocess=True
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    )
    ^
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\marshmallow\schema.py", line 999, in _do_load
    raise exc
marshmallow.exceptions.ValidationError: {'inputs': defaultdict(<class 'dict'>, {'training_data': {'value': [{'optional': ['Unknown field.']}, {'type': ["Value 'uri_folder' passed is not in set ['custom_model', 'mlflow_model', 'triton_model']"], 'optional': ['Unknown field.']}, {'type': ["Value 'uri_folder' passed is not in set ['mltable']"], 'optional': ['Unknown field.']}, {'optional': ['Unknown field.'], 'type': ['Unknown field.']}, {None: [{'_schema': ['Not a valid integer.']}, {'_schema': ['Not a valid number.']}, {'_schema': ['Not a valid string.']}, {'_schema': ['Not a valid boolean.']}]}]}, 'learning_rate': {'value': [{'type': ["Value 'number' passed is not in set ['uri_file', 'uri_folder']"], 'optional': ['Unknown field.'], 'default': ['Unknown field.']}, {'type': ["Value 'number' passed is not in set ['custom_model', 'mlflow_model', 'triton_model']"], 'optional': ['Unknown field.'], 'default': ['Unknown field.']}, {'type': ["Value 'number' passed is not in set ['mltable']"], 'optional': ['Unknown field.'], 'default': ['Unknown field.']}, {'optional': ['Unknown field.'], 'type': ['Unknown field.'], 'default': ['Unknown field.']}, {None: [{'_schema': ['Not a valid integer.']}, {'_schema': ['Not a valid number.']}, {'_schema': ['Not a valid string.']}, {'_schema': ['Not a valid boolean.']}]}]}})}

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azure\ai\ml\entities\_load_functions.py", line 106, in load_common
    return _load_common_raising_marshmallow_error(cls, yaml_dict, relative_origin, params_override, **kwargs)
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azure\ai\ml\entities\_load_functions.py", line 166, in _load_common_raising_marshmallow_error
    res: Resource = cls._load(data=yaml_dict, yaml_path=relative_origin, params_override=params_override, **kwargs)
                    ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azure\ai\ml\entities\_job\job.py", line 276, in _load
    job: Job = job_type._load_from_dict(
               ~~~~~~~~~~~~~~~~~~~~~~~~^
        data=data,
        ^^^^^^^^^^
    ...<3 lines>...
        **kwargs,
        ^^^^^^^^^
    )
    ^
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azure\ai\ml\entities\_builders\command.py", line 805, in _load_from_dict
    loaded_data = load_from_dict(CommandJobSchema, data, context, additional_message, **kwargs)
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azure\ai\ml\entities\_util.py", line 195, in load_from_dict
    raise ValidationError(decorate_validation_error(schema, pretty_error, additional_message)) from e
marshmallow.exceptions.ValidationError: Validation for CommandJobSchema failed:

 {
  "inputs": {
    "training_data": {
      "value": [
        {
          "optional": [
            "Unknown field."
          ]
        },
        {
          "type": [
            "Value 'uri_folder' passed is not in set ['custom_model', 'mlflow_model', 'triton_model']"
          ],
          "optional": [
            "Unknown field."
          ]
        },
        {
          "type": [
            "Value 'uri_folder' passed is not in set ['mltable']"
          ],
          "optional": [
            "Unknown field."
          ]
        },
        {
          "optional": [
            "Unknown field."
          ],
          "type": [
            "Unknown field."
          ]
        },
        {
          "null": [
            {
              "_schema": [
                "Not a valid integer."
              ]
            },
            {
              "_schema": [
                "Not a valid number."
              ]
            },
            {
              "_schema": [
                "Not a valid string."
              ]
            },
            {
              "_schema": [
                "Not a valid boolean."
              ]
            }
          ]
        }
      ]
    },
    "learning_rate": {
      "value": [
        {
          "type": [
            "Value 'number' passed is not in set ['uri_file', 'uri_folder']"
          ],
          "optional": [
            "Unknown field."
          ],
          "default": [
            "Unknown field."
          ]
        },
        {
          "type": [
            "Value 'number' passed is not in set ['custom_model', 'mlflow_model', 'triton_model']"
          ],
          "optional": [
            "Unknown field."
          ],
          "default": [
            "Unknown field."
          ]
        },
        {
          "type": [
            "Value 'number' passed is not in set ['mltable']"
          ],
          "optional": [
            "Unknown field."
          ],
          "default": [
            "Unknown field."
          ]
        },
        {
          "optional": [
            "Unknown field."
          ],
          "type": [
            "Unknown field."
          ],
          "default": [
            "Unknown field."
          ]
        },
        {
          "null": [
            {
              "_schema": [
                "Not a valid integer."
              ]
            },
            {
              "_schema": [
                "Not a valid number."
              ]
            },
            {
              "_schema": [
                "Not a valid string."
              ]
            },
            {
              "_schema": [
                "Not a valid boolean."
              ]
            }
          ]
        }
      ]
    }
  }
}

 If you are trying to configure a job that is not of type command, please specify the correct job type in the 'type' property.

Visit this link to refer to the CommandJob schema if needed: https://aka.ms/ml-cli-v2-job-command-yaml-reference.
The easiest way to author a specification file is using IntelliSense and auto-completion Azure ML VS code extension provides: https://code.visualstudio.com/docs/datascience/azure-machine-learning. To set up: https://learn.microsoft.com/azure/machine-learning/how-to-setup-vs-code

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azext_mlv2\manual\custom\job.py", line 86, in ml_job_create
    job = load_job(source=file, params_override=params_override)
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azure\ai\ml\entities\_load_functions.py", line 233, in load_job
    return cast(Job, load_common(Job, source, relative_origin, params_override, **kwargs))
                     ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azure\ai\ml\entities\_load_functions.py", line 131, in load_common
    validation_result.try_raise(error_func=build_error)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azure\ai\ml\entities\_validation\core.py", line 253, in try_raise
    raise error_func(
    ...<2 lines>...
    )
marshmallow.exceptions.ValidationError: Validation for CommandSchema failed:

 {
  "result": "Failed",
  "errors": [
    {
      "message": "Validation for CommandJobSchema failed:\n\n {\n  \"inputs\": {\n    \"training_data\": {\n      \"value\": [\n        {\n          \"optional\": [\n            \"Unknown field.\"\n          ]\n        },\n        {\n          \"type\": [\n            \"Value 'uri_folder' passed is not in set ['custom_model', 'mlflow_model', 'triton_model']\"\n          ],\n          \"optional\": [\n            \"Unknown field.\"\n          ]\n        },\n        {\n          \"type\": [\n            \"Value 'uri_folder' passed is not in set ['mltable']\"\n          ],\n          \"optional\": [\n            \"Unknown field.\"\n          ]\n        },\n        {\n          \"optional\": [\n            \"Unknown field.\"\n          ],\n          \"type\": [\n            \"Unknown field.\"\n          ]\n        },\n        {\n          \"null\": [\n            {\n              \"_schema\": [\n                \"Not a valid integer.\"\n             
 ]\n            },\n            {\n              \"_schema\": [\n                \"Not a valid number.\"\n              ]\n            },\n            {\n              \"_schema\": [\n                \"Not a valid string.\"\n              ]\n            },\n            {\n              \"_schema\": [\n                \"Not a valid boolean.\"\n              ]\n            }\n          ]\n        }\n      ]\n    },\n    \"learning_rate\": {\n      \"value\": [\n        {\n          \"type\": [\n            \"Value 'number' passed is not in set ['uri_file', 'uri_folder']\"\n          ],\n          \"optional\": [\n            \"Unknown field.\"\n          ],\n          \"default\": [\n            \"Unknown field.\"\n          ]\n        },\n        {\n          \"type\": [\n            \"Value 'number' passed is not in set ['custom_model', 'mlflow_model', 'triton_model']\"\n          ],\n          \"optional\": [\n            \"Unknown field.\"\n          ],\n          \"default\": [\n            \"Unknown field.\"\n          ]\n        },\n        {\n          \"type\": [\n            \"Value 'number' passed is not in set ['mltable']\"\n          ],\n          \"optional\": [\n            \"Unknown field.\"\n          ],\n          \"default\": [\n            \"Unknown field.\"\n          ]\n        },\n        {\n          \"optional\": [\n            \"Unknown field.\"\n          ],\n          \"type\": [\n          
  \"Unknown field.\"\n          ],\n          \"default\": [\n            \"Unknown field.\"\n          ]\n        },\n        {\n          \"null\": [\n            {\n              \"_schema\": [\n                \"Not a valid integer.\"\n              ]\n            },\n            {\n              \"_schema\": [\n                \"Not a valid number.\"\n              ]\n            },\n            {\n              \"_schema\": [\n                \"Not a valid string.\"\n              ]\n            },\n            {\n              \"_schema\": [\n                \"Not a valid boolean.\"\n              ]\n            }\n          
]\n        }\n      ]\n    }\n  }\n} \n\n If you are trying to configure a job that is not of type command, please specify the correct job type in the 'type' property.\n\nVisit this link to refer to the CommandJob schema if needed: https://aka.ms/ml-cli-v2-job-command-yaml-reference.\nThe easiest way to author a specification file is using IntelliSense and auto-completion Azure ML VS code extension provides: https://code.visualstudio.com/docs/datascience/azure-machine-learning. To set up: https://learn.microsoft.com/azure/machine-learning/how-to-setup-vs-code",
      "path": "*",
      "value": null,
      "location": ".\\test.yaml"
    }
  ]
}

 If you are trying to configure an entity that is not of type command, please specify the correct type in the 'type' property.
The easiest way to author a specification file is using IntelliSense and auto-completion Azure ML VS code extension provides: https://code.visualstudio.com/docs/datascience/azure-machine-learning. To set up: https://learn.microsoft.com/azure/machine-learning/how-to-setup-vs-code

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\knack/cli.py", line 233, in invoke
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 666, in execute
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 734, in _run_jobs_serially
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 703, in _run_job
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 336, in __call__
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/command_operation.py", line 120, in handler
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azext_mlv2\manual\custom\job.py", line 105, in ml_job_create
    log_and_raise_error(err, debug, yaml_operation=yaml_operation)
    ~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\noraabiakar\.azure\cliextensions\ml\azext_mlv2\manual\custom\raise_error.py", line 193, in log_and_raise_error
    raise cli_error
knack.util.CLIError:
The yaml file you provided does not match the prescribed schema for CommandJob yaml files and/or has the following issues:

Error:
1) A least one unrecognized parameter is specified

Details: Validation for CommandSchema failed

(x) inputs:
- optional:
    - Unknown field.

Resolutions:
1) Remove any parameters not prescribed by the CommandJob schema.
Visit this link to refer to the CommandJob schema if needed: https://aka.ms/ml-cli-v2-job-command-yaml-reference.
If using the CLI, you can also check the full log in debug mode for more details by adding --debug to the end of your command

Additional Resources: The easiest way to author a yaml specification file is using IntelliSense and auto-completion Azure ML VS code extension provides: https://code.visualstudio.com/docs/datascience/azure-machine-learning. To set up VS Code, visit https://learn.microsoft.com/azure/machine-learning/how-to-setup-vs-code


cli.azure.cli.core.azclierror: 
The yaml file you provided does not match the prescribed schema for CommandJob yaml files and/or has the following issues:

Error:
1) A least one unrecognized parameter is specified

Details: Validation for CommandSchema failed

(x) inputs:
- optional:
    - Unknown field.

Resolutions:
1) Remove any parameters not prescribed by the CommandJob schema.
Visit this link to refer to the CommandJob schema if needed: https://aka.ms/ml-cli-v2-job-command-yaml-reference.
If using the CLI, you can also check the full log in debug mode for more details by adding --debug to the end of your command

Additional Resources: The easiest way to author a yaml specification file is using IntelliSense and auto-completion Azure ML VS code extension provides: https://code.visualstudio.com/docs/datascience/azure-machine-learning. To set up VS Code, visit https://learn.microsoft.com/azure/machine-learning/how-to-setup-vs-code

az_command_data_logger:
The yaml file you provided does not match the prescribed schema for CommandJob yaml files and/or has the following issues:

Error:
1) A least one unrecognized parameter is specified

Details: Validation for CommandSchema failed

(x) inputs:
- optional:
    - Unknown field.

Resolutions:
1) Remove any parameters not prescribed by the CommandJob schema.
Visit this link to refer to the CommandJob schema if needed: https://aka.ms/ml-cli-v2-job-command-yaml-reference.
If using the CLI, you can also check the full log in debug mode for more details by adding --debug to the end of your command

Additional Resources: The easiest way to author a yaml specification file is using IntelliSense and auto-completion Azure ML VS code extension provides: https://code.visualstudio.com/docs/datascience/azure-machine-learning. To set up VS Code, visit https://learn.microsoft.com/azure/machine-learning/how-to-setup-vs-code

cli.knack.cli: Event: Cli.PostExecute [<function AzCliLogging.deinit_cmd_metadata_logging at 0x045A8168>]
az_command_data_logger: exit code: 1
cli.__main__: Command ran in 6.502 seconds (init: 0.549, invoke: 5.953)
telemetry.main: Begin splitting cli events and extra events, total events: 1
telemetry.client: Accumulated 0 events. Flush the clients.
telemetry.main: Finish splitting cli events and extra events, cli events: 1
telemetry.save: Save telemetry record of length 4869 in cache file under C:\Users\noraabiakar\.azure\telemetry\20251014102933646
telemetry.main: Begin creating telemetry upload process.
telemetry.process: Creating upload process: "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\python.exe C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\Lib\site-packages\azure\cli\telemetry\__init__.pyc C:\Users\noraabiakar\.azure C:\Users\noraabiakar\.azure\telemetry\20251014102933646"
telemetry.process: Return from creating process 23540
telemetry.main: Finish creating telemetry upload process.

Expected behavior

The command should work.

Environment Summary

azure-cli 2.78.0

core 2.78.0
telemetry 1.1.0

Extensions:
ad 0.1.0
aks-preview 14.0.0b2
azure-iot 0.26.0
connectedk8s 1.10.7
containerapp 1.1.0b4
customlocation 0.1.4
k8s-extension 1.6.4
load 2.0.0
ml 2.39.0
resource-graph 2.1.1
ssh 2.0.6
storage-preview 1.0.0b5

Dependencies:
msal 1.34.0b1
azure-mgmt-resource 23.3.0

Python location 'C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\python.exe'
Config directory 'C:\Users\noraabiakar.azure'
Extensions directory 'C:\Users\noraabiakar.azure\cliextensions'

Python (Windows) 3.13.7 (tags/v3.13.7:bcee1c3, Aug 14 2025, 14:06:58) [MSC v.1944 32 bit (Intel)]

Legal docs and information: aka.ms/AzureCliLegal

Your CLI is up-to-date.

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    Auto-AssignAuto assign by botConnected KubernetesMachine LearningService AttentionThis issue is responsible by Azure service team.bugThis issue requires a change to an existing behavior in the product in order to be resolved.extension/ml

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions