Change log for ARCSIGHT_CEF

Date Changes
2025-11-12 Enhancement:
- `event.idm.read_only_udm.metadata.event_type`: Updated to STATUS_UPDATE if a principal MAC address (amac) is present, otherwise defaults to GENERIC_EVENT.
- `event.idm.read_only_udm.additional.fields`: Newly mapped `version` raw log field(s) with `event.idm.read_only_udm.additional.fields` UDM field.
- `event.idm.read_only_udm.principal.hostname`: The value from the `shost` raw log field is now truncated to 255 characters if its length is greater than or equal to 255.
2025-11-05 Enhancement:
- Enhanced `shost` parsing: Modified logic to map shost field correctly.
- Enhanced `dhost` parsing: Added logic to extract IP addresses from `dhost` when it is a valid IP address.
- event.idm.read_only_udm.observer.application: Newly mapped `at` raw log field to `event.idm.read_only_udm.observer.application`.
- event.idm.read_only_udm.observer.ip: Newly mapped `agt` raw log field to `event.idm.read_only_udm.observer.ip`.
- event.idm.read_only_udm.observer.hostname: Newly mapped `ahost` raw log field to `event.idm.read_only_udm.observer.hostname`.
- event.idm.read_only_udm.about.file.mime_type: Newly mapped `fileType` raw log field to `event.idm.read_only_udm.about.file.mime_type`.
- event.idm.read_only_udm.principal.location.region_longitude: Newly mapped `slong` raw log field to `event.idm.read_only_udm.principal.location.region_longitude`.
- event.idm.read_only_udm.principal.location.region_latitude: Newly mapped `slat` raw log field to `event.idm.read_only_udm.principal.location.region_latitude`.
- event.idm.read_only_udm.security_result.priority_details: Newly mapped `priority` raw log field to `event.idm.read_only_udm.security_result.priority_details`.
- event.idm.read_only_udm.security_result.attack_details.techniques: Newly mapped `categoryTechnique` raw log field to `event.idm.read_only_udm.security_result.attack_details.techniques`.
- event.idm.read_only_udm.network.session_id: Newly mapped `sessionId` raw log field to `event.idm.read_only_udm.network.session_id`.
- event.idm.read_only_udm.additional.fields: Newly mapped `eventAnnotationModificationTime`, `eventAnnotationAuditTrail`, `eventAnnotationVersion`, `eventAnnotationFlags`, `eventAnnotationEndTime`, `eventAnnotationManagerReceiptTime`, `type`, `end`, `mrt`, `generatorID`, `cryptoSignature`, `customerID`, `customerURI`, `modelConfidence`, `relevance`, `assetCriticality`, `ruleThreadId`, `locality`, `atz`, `deviceZoneID`, `deviceZoneURI`, `dtz`, `deviceFacility`, `eventAnnotationStageUpdateTime`, `_cefVer`, `arcSightEventPath`, `baseEventIds` and `av` raw log fields to `event.idm.read_only_udm.additional.fields`.
2025-10-27 Enhancement:
- Added support for NON-CEF json logs.
- event.idm.read_only_udm.principal.ip: Newly mapped `client_ip` raw log field to `event.idm.read_only_udm.principal.ip`.
- event.idm.read_only_udm.principal.asset.ip: Newly mapped `client_ip` raw log field to `event.idm.read_only_udm.principal.asset.ip`.
- event.idm.read_only_udm.principal.hostname: Newly mapped `ident` raw log field to `event.idm.read_only_udm.principal.hostname`.
- event.idm.read_only_udm.principal.asset.hostname: Newly mapped `ident` raw log field to `event.idm.read_only_udm.principal.asset.hostname`.
- event.idm.read_only_udm.principal.user.userid: Newly mapped `auth` raw log field to `event.idm.read_only_udm.principal.user.userid`.
- event.idm.read_only_udm.metadata.event_timestamp: Newly mapped `timestamp` raw log field to `event.idm.read_only_udm.metadata.event_timestamp`.
- event.idm.read_only_udm.network.http.method: Newly mapped `http_method` raw log field to `event.idm.read_only_udm.network.http.method`.
- event.idm.read_only_udm.network.http.referral_url: Newly mapped `http_uri` raw log field to `event.idm.read_only_udm.network.http.referral_url`.
- event.idm.read_only_udm.network.http.response_code: Newly mapped `http_status_code` raw log field to `event.idm.read_only_udm.network.http.response_code`.
- event.idm.read_only_udm.network.received_bytes: Newly mapped `response_bytes` raw log field to `event.idm.read_only_udm.network.received_bytes`.
- event.idm.read_only_udm.intermediary: Newly mapped `host` raw log field to `event.idm.read_only_udm.intermediary`.
- event.idm.read_only_udm.additional.fields: Newly mapped `sourcetype`, `source` and `cribl_test` raw log field to `event.idm.read_only_udm.additional.fields`.
- event.idm.read_only_udm.principal.ip: Newly mapped `source_ip` raw log field to `event.idm.read_only_udm.principal.ip`.
- event.idm.read_only_udm.principal.asset.ip: Newly mapped `source_ip` raw log field to `event.idm.read_only_udm.principal.asset.ip`.
- event.idm.read_only_udm.principal.hostname: Newly mapped `source_host` raw log field to `event.idm.read_only_udm.principal.hostname`.
- event.idm.read_only_udm.principal.asset.hostname: Newly mapped `source_host` raw log field to `event.idm.read_only_udm.principal.asset.hostname`.
- event.idm.read_only_udm.target.hostname: Newly mapped `destination_host` raw log field to `event.idm.read_only_udm.target.hostname`.
- event.idm.read_only_udm.target.asset.hostname: Newly mapped `destination_host` raw log field to `event.idm.read_only_udm.target.asset.hostname`.
- Added grok patterns to extract `source_ip` and `source_host` from the `shost` field for CEF logs.
- Added grok pattern to extract `destination_host` from the `dhost` field for CEF logs.
- Added grok patterns to extract `intermediary_hostname` from the `temp_data` field for CEF logs.
2025-08-04 Enhancement:
- event.idm.read_only_udm.about.ip: Removed mapping of `dvc` from `event.idm.read_only_udm.about.ip` UDM field as the `dvc` field represents an intermediary system, not a system the event is directly about.
- event.idm.read_only_udm.intermediary.ip: Newly mapped `dvc`log fields with `event.idm.read_only_udm.intermediary.ip` UDM field.
- event.idm.read_only_udm.about.hostname: Removed mapping of `dvchost` from `event.idm.read_only_udm.about.hostname` UDM field as `dvchost` value in the raw logs represents an intermediary system communicating with the host and not the actual about.
- event.idm.read_only_udm.intermediary.hostname: Newly mapped `dvchost` log fields with `event.idm.read_only_udm.intermediary.hostname` UDM field.
- event.idm.read_only_udm.principal.mac: Newly mapped `amac` raw log field to `event.idm.read_only_udm.principal.mac`using regex validation `^(([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2})$` Invalid values are captured in `event.idm.read_only_udm.additional.fields` with the key `amac` to prevent data loss.
- event.idm.read_only_udm.metadata.product_log_id: Newly mapped `geid` raw log field to `event.idm.read_only_udm.metadata.product_log_id`.
- event.idm.read_only_udm.additional.fields: Newly mapped `aid` and `art` raw log fields to `event.idm.read_only_udm.additional.fields`.
- event.idm.read_only_udm.security_result.detection_fields: Newly mapped `categorySignificance`, `categoryBehavior`, `categoryObject`, and `deviceSeverity` raw log fields to `event.idm.read_only_udm.security_result.detection_fields`.
- event.idm.read_only_udm.security_result.outcomes: Newly mapped `categoryOutcome` raw log field to `event.idm.read_only_udm.security_result.outcomes`.
- Added a grok pattern to handle negative integer values and mapped `in` raw log field to `event.idm.read_only_udm.network.received_bytes`.
- Added a grok pattern to handle negative integer values and mapped `out` raw log field to `event.idm.read_only_udm.network.sent_bytes`.
2025-06-05 Enhancement:
- Added support to remove unnecessary brackets from `event.idm.read_only_udm.metadata.product_event_type`.
2025-03-11 Enhancement:
- Mapped "cn3" to "network.duration.seconds".
- Mapped "PanOSTenantID" to "additional.fields".
- Added support for "User Login" events.
2025-01-31 Enhancement:
- Mapped "cn3" to "additional.fields".
- Mapped "PanOSCortexDataLakeTenantID" to "additional.fields".
2025-01-17 Enhancement:
- Mapped "target_user" to "target.user.userid".
- Mapped "principal_ip" to "principal.ip".
- Mapped "PanOSStage", "PanOSConnectionError", and "PanOSEventDetails" to "additional.fields".
- Mapped "outcome" to "security_result.action_details".
2024-12-12 Enhancement:
- Mapped "Name" to "additional.fields".
- Mapped "PanOSDescription" to "metadata.description".
- Mapped "PanOSSourceUser" to "principal.user.userid".
- Mapped "outcome" to "security_result.action_details".
- If "outcome" equals "success", mapped "security_result.action" to "ALLOW".
2024-07-30 Enhancement:
- Mapped "app" to "target.application".
- Mapped "flexString2", "PanOSFileHash", and "filePath" to "additional.fields".
- Mapped "threat_name" to "security_result.threat_name".
- Mapped "threat_id" to "security_result.threat_id".
- When "device_event_class_id" is not "THREAT", then mapped "cat" to "additional.fields".
2024-06-18 Enhancement:
- Added support to parse unparsed logs failing due to validation error.
2024-04-03 Enhancement:
- Mapped "principal_ip1" to "principal.ip" and "principal.asset.ip".
- Mapped "deviceExternalId" to "about.asset.hardware.serial_number".
- When principal data and target data is present, then set "metadata.event_type" to "NETWORK_CONNECTION".
- When principal data and target resource data is present, then set "metadata.event_type" to "USER_RESOURCE_ACCESS".
- When principal data is present, then set "metadata.event_type" to "STATUS_UPDATE".
2024-02-18 Enhancement -
- Added support to parse "PAN_FIREWALL" logs.
- Mapped "metadata.event_type" to "NETWORK_CONNECTION" if "device_event_class_id" is in "TRAFFIC", "THREAT", "URL", "WILDFIRE", "DATA", "TUNNEL".
- Mapped "PanOSConfigVersion" to "security_result.detection_fields".
- Mapped "deviceOutboundInterface", "deviceInboundInterface" to "additional.fields".
2024-02-12 Enhancement -
- Mapped "query" to "additional fields".
- Added a Grok pattern to parse logs with query value "json_data".
2023-04-27 Enhancement -
- Mapped "proto" to "network.ip_protocol".
2022-11-15 Enhancement -
- Mapped "PanOSThreatCategory" to "security_result.category_details".
- Mapped "PanOSThreatID" to "security_result.threat_id",
- Mapped "PanOSContentVersion" to "security_result.detection_fields".
- Mapped "PanOSRuleUUID" to "metadata.product_log_id".
- Mapped "PanOSDestinationLocation" to "target.location.country_or_region".
- Mapped "PanOSDGHierarchyLevel1" to "security_result.detection_fields".
2022-08-26 Enhancement - Migrated the custom parsers into default parser.