Commit Graph

27 Commits

Author SHA1 Message Date
Nicolas
ec93fc987c feat(opentelemetry): add additional Kubernetes labels and enhance logging attributes 2025-09-28 09:07:42 +08:00
Nicolas
beb355249a fix: update centralStorage OpenTelemetry configuration
- Change start_at from 'end' to 'beginning' for complete log history
- Fix transform configuration to match authentication service
- Add k8s_cluster receiver to collect container stdout logs
- Remove problematic json_parser operator
- Ensure consistent log processing across services
2025-09-23 08:58:01 +08:00
Nicolas
aa74f6a4f7 fix: remove invalid k8scluster receiver to resolve OpenTelemetry startup error
- Remove k8scluster receiver (invalid type name)
- Remove unused otlp receiver definitions
- Keep only filelog receiver which is actually used in pipeline
- Fixes CrashLoopBackOff issue in central-storage pod
2025-08-01 07:52:37 +08:00
Nicolas
d85f9408e4 fix: change Chinese comments to English in OpenTelemetry configs
- Replace Chinese comments with English in opentelemetry.yaml files
- Maintain consistent English-only comments in freeleaps-ops repository
- Keep the same functionality while improving code readability
2025-07-31 23:17:45 +08:00
Nicolas
5101e6d2cd fix: optimize OpenTelemetry configuration to prevent duplicate log collection
- Change receivers from [filelog, otlp, k8scluster] to [filelog] only
- Prevent duplicate logs from multiple collection sources
- Keep only filelog receiver to collect logs from application log files
- This eliminates duplicate logs appearing in Grafana for devsvc and central-storage
2025-07-31 23:08:10 +08:00
Nicolas
cc73ad92a9 feat: add container logs collection to OpenTelemetry config for central storage 2025-07-31 11:27:28 +08:00
Nicolas
7a7fcf1398 fix: optimize central storage logging configuration to resolve hourly log bursts
- Change start_at from beginning to end to avoid historical log duplication
- Add poll_interval: 1s for real-time file monitoring
- Optimize batch processing: send_batch_size: 1, timeout: 1s
- Add PVC template for log persistence to reduce log loss risk
- Update deployment to support persistent volume for logs
2025-07-31 10:14:55 +08:00
Nicolas
f9c2c7e696 Change OTC start_at to beginning to read existing logs 2025-07-29 18:04:53 +08:00
Nicolas
401a2166cd Simplify OTC config: remove timestamp parsing to fix startup issues 2025-07-29 17:57:30 +08:00
Nicolas
7ae5966da1 Fix timestamp parsing: use move operator to extract timestamp from attributes 2025-07-29 17:54:25 +08:00
Nicolas
12a7f1b98c Fix timestamp parsing in OTC config for central-storage logs 2025-07-29 17:40:57 +08:00
Nicolas
c4bd3df730 Fix OTLP exporter config: remove unsupported labels options 2025-07-29 17:22:40 +08:00
Nicolas
18eb4df3fb Revert to OTLP config to fix OTC startup - will investigate Loki config later 2025-07-29 17:16:46 +08:00
Nicolas
d234716697 Comment out Loki labels config to fix OTC startup - can be enabled later 2025-07-29 17:13:01 +08:00
Nicolas
b1c9f59cff Simplify Loki exporter configuration to fix OTC startup issues 2025-07-29 17:08:32 +08:00
Nicolas
a1d5652efb Fix Loki exporter configuration: remove invalid keys 2025-07-29 17:05:24 +08:00
Nicolas
b7b6ddcae4 Fix central-storage logging: change OTLP exporter to Loki HTTP exporter 2025-07-29 16:47:47 +08:00
Nicolas
acd5379c27 fix: restore json_parser with timestamp parsing based on local testing 2025-07-29 15:40:26 +08:00
Nicolas
beab7cd117 fix: remove all parsing operators to use raw log content 2025-07-29 15:29:53 +08:00
Nicolas
37db3b4404 fix: remove time_parser to use default timestamp handling 2025-07-29 14:46:13 +08:00
Nicolas
5479b85968 fix: separate timestamp parsing from json_parser to resolve time parsing error 2025-07-29 14:42:29 +08:00
Nicolas
aa8e626b7a fix: remove problematic ParseJSON operations from OpenTelemetry transform processor 2025-07-29 14:30:00 +08:00
Nicolas
22ab4b99ef fix: simplify OpenTelemetry Collector config to resolve timestamp parsing errors 2025-07-29 14:07:39 +08:00
Nicolas
5ced605a20 fix: improve OpenTelemetry Collector JSON parsing for central storage logs 2025-07-29 10:15:39 +08:00
Nicolas
8fc5281e23 feat: add DEBUG_MODE environment variable for central-storage 2025-07-28 21:00:33 +08:00
Nicolas
381d25c11b chore(logging): update logPathPattern to /var/log/pods/*/*/*.log for k8s standard log collection 2025-07-25 11:05:28 +08:00
zhenyus
6d9d15d4d2 Add OpenTelemetry logging support across multiple services
- Introduced log ingestion configuration in values files for centralStorage, content, notification, and payment services.
- Updated deployment templates to conditionally include OpenTelemetry annotations and volume mounts based on log ingestion settings.
- Added OpenTelemetry RBAC configurations for service accounts and cluster roles to enable logging.
- Implemented OpenTelemetry collector configuration to process logs and export them to Loki.
- Ensured compatibility with existing Helm chart structure and maintained backward compatibility for services without log ingestion enabled.

Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 22:03:00 +08:00