Enterprise Log Aggregation and Security Correlation System

Design a distributed log processing system that can ingest logs from multiple enterprise sources (Kubernetes clusters, network firewalls, cloud services, on-premise servers) in real-time. Implement machine learning-based anomaly detection, create automated threat scoring, generate instant security incident reports, and trigger predefined remediation workflows when specific security thresholds are crossed. The system must handle over 10,000 log entries per second with less than 100ms processing latency.