Microsoft Azure Stream Analytics

❗️
This source has been deprecated
observIQ is in the process of transitioning a subset of BindPlane's monitoring capabilities to the observIQ OpenTelemetry Collector. As a result, this Source is no longer publicly available in BindPlane. If you need access to this Source, please reach out to our support via chat or via [email protected].

Please refer to the Microsoft Azure Sources topic for additional information on how to configure the LPU, and general Azure Data Collection setup details.

Least Privileged User

Steps:

Using the Azure CLI Client, find the Subscription ID and Tenant ID from your account list
Create a custom RBAC role using the JSON provided. Include your Subscription ID and rename the file to azure.json
Create an Active Directory Service Principal and assign the custom RBAC role t it.

Creating custom roles using the Azure CLI:

https://docs.microsoft.com/en-us/azure/role-based-access-control/custom-roles

Assigning roles using the Azure CLI:

https://docs.microsoft.com/en-us/azure/role-based-access-control/role-assignments-portal

{
  "Name": "LPU Microsoft Azure Stream Analytics",
  "Description": "LPU for Microsoft Azure Stream Analytics",
  "Actions": [
    "Microsoft.StreamAnalytics/streamingjobs/*/read",
    "Microsoft.Insights/metrics/*/read",
    "Microsoft.Authorization/*/read"
  ],
  "AssignableScopes": [
    "/subscriptions/[Subscription ID]"
  ]
}

Connection Parameters

Name	Required?	Description
Subscription ID	Required	GUID Subscription ID
Tenant ID	Required	GUID Tenant ID (also known as Directory ID)
Client ID	Required	GUID Client ID (also known as Application ID)
Client Secret	Required	The Secret (also known as Key) corresponding to the Client ID.
Maximum HTTP Retry Time (seconds)		The maximum amount of time in seconds to retry each API request when the API is throttling.
HTTP Request Timeout (seconds)		The maximum amount of time in seconds before a single HTTP request will fail.

Metrics

API Usage

Name	Description
Average Pages	The average amount of pages needed for a paged resource type.
Average Request Retries	The average number of retry requests per unique requests made.
Average Retry Attempts	The average number of retry requests made per unique request that was retried.
Average Retry Wait (Milliseconds)	The average amount of time retried requests spent waiting.
Client ID	The client ID used to make API calls.
Failed Requests	The total number of requests that returned a failure response.
Maximum Pages	The most amount of pages needed for a paged resource type.
Maximum Retries	The highest number of retries made for a single request.
Maximum Retry Wait (Milliseconds)	The most amount of time a retried request spent waiting.
Minimum Pages	The least amount of pages needed for a paged resource type.
Minimum Retry Wait (Milliseconds)	The least amount of time a retried request spent waiting.
Other Status Responses	The total number of successful requests that responded with some other accepted status.
Request Timeouts	The total number of requests that timed out waiting for a response.
Requests Retried	The number of unique requests that were retried.
Retry Status Responses	The total number of successful requests that responded with the status TOO MANY REQUESTS (429).
Retry Timeouts	The total number of requests that needed to be retried, but the request retry time exceeded the maximum retry time.
Status OK Responses	The total number of successful requests that responded with the status OK (200).
Subscription ID	The subscription ID used to make API calls.
Successful Requests	The total number of requests that returned a successful response.
Tenant ID	The tenant ID used to make API calls.
Total Monitor Requests	The total number of requests made to get monitor metrics.
Total Paged Requests	The total amount of resource types that required paging.
Total Requests	The total number of requests made during collection.
Total Retries	The total number of retry requests that were made.
Unique Monitor Requests	The number of unique requests made to get monitor metrics.
Unique Requests	The number of requests made with unique endpoints.

Function

Name	Description
ID	Azure resource ID.
Name	Azure resource name.
Type	Job function type.

Input

Name	Description
Compression Type	Data compression type.
Data Type	Data type.
Datasource Type	Data source type.
ID	Azure resource ID.
Name	Azure resource name.
Serialization Type	Data serialization type.

Job

Name	Description
Azure Machine Learning Callout Input Events Count	Total number of Azure Machine Learning callout input events.
Azure Machine Learning Callout Requests Count	Total number of Azure Machine Learning callout requests.
Azure Machine Learning Failed Requests Count	Total number of failed Azure Machine Learning callout requests.
Conversion Errors Count	Total number of conversion errors.
Created Date	Job creation date.
Deserialization Errors Count	Total number of deserialization count.
Dropped Events Count	Total number of dropped or adjusted events.
Early Input Events Count	Total number of early input events.
Errors Count	Total number of errors.
Events Late Arrival Maximum Delay (Seconds)	Maximum delay for events arriving late.
Events Out Of Order Maximum Delay (Seconds)	Maximum delay for out of order events.
Events Out Of Order Policy	Job policy for out of order events.
ID	Azure resource ID.
Input Events Count	Total number of input events.
Input Events Size (Bytes)	Total size of input events.
Last Output Event Time	Time of last output event.
Late Input Events Count	Total number of late input events.
Location	Location where this resource lives.
Name	Azure resource name.
Output Error Policy	Job policy for output errors.
Output Events Count	Total number of output events.
Output Start Mode	When to start job output.
Output Start Time	Time when job starts output.
Provisioning State	Provisioning state of this job.
SKU Name	Azure SKU name.
State	Job runtime state.
Streaming Units Utilization (%)	The current utilization of streaming units.

Output

Name	Description
Compression Type	Data compression type.
Data Type	Data type.
Datasource Type	Data source type.
ID	Azure resource ID.
Name	Azure resource name.
Serialization Type	Data serialization type.

❗️This source has been deprecated

Least Privileged User

Steps:

Creating custom roles using the Azure CLI:

Assigning roles using the Azure CLI:

Connection Parameters

Metrics

API Usage

Function

Input

Job

Output

❗️
This source has been deprecated