Commit Graph

180 Commits

Author SHA1 Message Date
zhenyus
fb368eb8d8 fix(opentelemetry): remove commented-out k8sattributes actions for clarity
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 16:44:13 +08:00
zhenyus
b0a1e56a75 fix(opentelemetry): correct syntax for accessing context attributes in log transformation
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 16:43:24 +08:00
zhenyus
5f1742e22e refactor(opentelemetry): reorganize log transformation logic for clarity and consistency
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 16:42:28 +08:00
zhenyus
2e1879298f fix(opentelemetry): remove k8sattributes processor from logs pipeline for simplification
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 16:32:06 +08:00
zhenyus
1967a7444c fix(opentelemetry): comment out unused k8sattributes processor and related actions for clarity
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 16:31:29 +08:00
zhenyus
80e75eea27 fix(opentelemetry): add telemetry logging level configuration for improved log management
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 16:26:06 +08:00
zhenyus
4ee81552a2 fix(opentelemetry): streamline attributes configuration by removing redundant labeling actions
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 16:19:03 +08:00
zhenyus
222f5ee0fb feat(opentelemetry): add structured metadata support and update log transformation logic
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 16:16:03 +08:00
zhenyus
6bbc81a940 fix(opentelemetry): restore otlphttp/logs exporter configuration for log ingestion
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 16:00:50 +08:00
zhenyus
44e1213253 fix(opentelemetry): add labeling attributes for app and environment context
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 15:59:59 +08:00
zhenyus
884a535dd5 fix(auth): update lokiEndpoint to remove unnecessary path for log ingestion
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 15:29:35 +08:00
zhenyus
8dda0bada9 fix(opentelemetry): enhance log transformation by adding log statements and updating exporters
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 15:27:46 +08:00
zhenyus
4d591a03c0 fix(opentelemetry): reduce batch send size for log processing to improve performance
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 15:15:30 +08:00
zhenyus
0e967bf12c fix(opentelemetry): add debug exporter to log pipeline for detailed verbosity
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 15:09:44 +08:00
zhenyus
544293f7b2 fix(opentelemetry): refine log processing by removing unnecessary fields and enhancing attribute insertion
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 15:05:05 +08:00
zhenyus
90b4b3bb9b fix(opentelemetry): simplify log transformation by removing unnecessary merge operation
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 14:49:20 +08:00
zhenyus
3daf27cb4d fix(opentelemetry): enhance log transformation logic to include merging attributes
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 14:46:52 +08:00
zhenyus
19626a44fa fix(opentelemetry): update log ingestion settings and enhance transformation logic
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-21 14:38:55 +08:00
freeleaps-gitops-bot
d087f1d360 ci(bump): bump authentication image version for alpha to snapshot-ecad36a 2025-04-21 05:33:20 +00:00
freeleaps-gitops-bot
3132b59a81 ci(bump): bump authentication image version for alpha to snapshot-32c4fe9 2025-04-21 03:56:29 +00:00
freeleaps-gitops-bot
be745ba915 ci(bump): bump authentication image version for alpha to 1.1.1 2025-04-21 03:07:41 +00:00
freeleaps-gitops-bot
e937aaa092 ci(bump): bump authentication image version for prod to 1.1.1 2025-04-18 04:56:16 +00:00
zhenyus
33c91ecb8d fix: remove debug exporter and adjust k8sattributes processor configuration in OpenTelemetry setup
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 10:34:22 +08:00
zhenyus
354f6b2669 fix: add missing remove operator for body field in OpenTelemetry log processing
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 07:29:19 +08:00
zhenyus
b42a6ee07f fix: remove unnecessary transform processor from OpenTelemetry log pipeline
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 07:26:40 +08:00
zhenyus
e60016366e fix: correct indentation for OpenTelemetry config checksum annotation in deployment
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 07:26:19 +08:00
zhenyus
d7c952fe2e fix: add missing annotations for OpenTelemetry configuration in deployment
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 07:25:09 +08:00
zhenyus
c85f4966c5 fix: remove transform section from OpenTelemetry configuration
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 07:23:27 +08:00
zhenyus
9f9151ad12 fix: remove unnecessary format field from loki exporter configuration
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 07:19:30 +08:00
zhenyus
a72ed9b1b9 feat: add additional fields for pod IP and node name in OpenTelemetry log transformation
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 07:18:50 +08:00
zhenyus
61e3f5caff fix: add missing id field to json_parser operator and update transform statements in OpenTelemetry configuration
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 07:17:23 +08:00
zhenyus
fb0c828156 fix: add missing id field for json_parser operator in OpenTelemetry configuration
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 07:06:41 +08:00
zhenyus
a8a0251f4e feat: add OpenTelemetry config checksum to deployment annotations
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 07:01:35 +08:00
zhenyus
063a2c3eea fix: remove unnecessary json_parser configuration from OpenTelemetry collector
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 07:00:42 +08:00
zhenyus
d597e30b1b feat: update log ingestion configuration for OpenTelemetry collector
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 06:58:07 +08:00
zhenyus
97d906939e fix: add security context for OpenTelemetry collector in configuration
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 06:46:10 +08:00
zhenyus
8281c6eef7 feat: add volume mounts for log ingestion in OpenTelemetry and deployment configurations
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 06:35:51 +08:00
zhenyus
a01184310d fix: move serviceAccountName configuration under spec section in deployment.yaml
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 06:32:01 +08:00
zhenyus
494ae78d5f fix: move serviceAccountName configuration under containers section in deployment.yaml
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 06:30:13 +08:00
zhenyus
0653829a07 fix: add serviceAccountName for OpenTelemetry collector in deployment configuration
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 06:27:49 +08:00
zhenyus
535de7a8aa fix: add quotes around serviceAccount name in OpenTelemetry configuration
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 06:25:50 +08:00
zhenyus
849511b6ca feat: add OpenTelemetry RBAC configuration with ServiceAccount and ClusterRole
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 06:17:32 +08:00
zhenyus
e4ad10886f fix: update OpenTelemetry configuration to include TLS settings for Loki exporter and remove logging exporter
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 06:15:00 +08:00
zhenyus
623d504c5c fix: correct indentation for logging configuration in OpenTelemetry YAML
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 06:13:41 +08:00
zhenyus
cf1506978f fix: add loki.format attribute for log ingestion and remove unnecessary labels from exporter configuration
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 06:12:42 +08:00
zhenyus
ed5c6a45af fix: refactor OpenTelemetry configuration by removing unused operators and restructuring metadata extraction
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 06:06:43 +08:00
zhenyus
b8af384f68 fix: update OpenTelemetry sidecar injection annotation for dynamic configuration
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 05:53:43 +08:00
zhenyus
b2dd79744b fix: correct syntax for 'from' field in OpenTelemetry configuration
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 05:50:50 +08:00
zhenyus
eedb1cefc7 fix: update CA injection annotations and webhook service URLs for OpenTelemetry operator
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 05:49:54 +08:00
zhenyus
a0d88d9507 Add OpenTelemetry Collector configuration for log ingestion
- Introduced a new OpenTelemetryCollector resource in the Helm chart.
- Configured filelog receiver to ingest logs based on specified patterns.
- Added processors for Kubernetes attributes and resource metadata.
- Set up Loki exporter for log forwarding with appropriate labels.
- Configured logging verbosity and defined log processing pipelines.

Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 05:45:40 +08:00
zhenyus
842f811767 fix: update resource kinds to Parser and Output for consistency and correct configuration
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 01:07:46 +08:00
zhenyus
4576a4fe1a fix: remove FluentBit resource definition and retain only ClusterParser for streamlined configuration
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 01:06:22 +08:00
zhenyus
b80518cdb7 fix: change kind from Parser and Output to ClusterParser and ClusterOutput for consistency
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 00:57:07 +08:00
zhenyus
d699274fe7 fix: change kind from FluentBitConfig to ClusterFluentBitConfig for correct resource definition
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 00:54:38 +08:00
zhenyus
decca8e7a1 fix: update labels for Fluent Bit resources to ensure correct identification
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 00:46:39 +08:00
zhenyus
b735ea1e0c fix: update namespace for Fluent Bit resources to freeleaps-logging-system
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 00:33:15 +08:00
zhenyus
a961051e0c fix: rename ClusterInput and update matchLabels for consistency
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 00:30:49 +08:00
zhenyus
f36a87eaca fix: add ClusterInput configuration for Fluent Bit log collection
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 00:29:00 +08:00
zhenyus
cf83b661d1 fix: add missing labels to Fluent Bit resources for consistency
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 00:28:40 +08:00
zhenyus
358f131809 Add Fluent Bit configuration for log collection
- Introduced Fluent Bit resources including FluentBit, Parser, Output, FluentBitConfig, and ClusterInput.
- Configured default resource requests and limits for Fluent Bit.
- Set up JSON parser with customizable time key and format.
- Established output forwarding to Fluentd service in the logging system.
- Enabled conditional deployment based on the `fluentbit.enabled` value in Helm chart.

Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-16 00:18:16 +08:00
zhenyus
6ebdef8933 Update ingress hosts and issuer references for alpha environment
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-04-11 01:22:29 +08:00
zhenyus
f415b83a85 ci: update execute mode to 'on-demand' in Jenkinsfiles and change MongoDB URIs to use SRV format
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-31 13:51:04 +08:00
freeleaps-gitops-bot
2e90445b15 ci(bump): bump authentication image version for alpha to snapshot-7940aa2 2025-03-30 23:05:19 +00:00
zhenyus
b3ad25d6e5 fix: update config file paths in config-checksum annotations for deployment templates
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-27 14:51:41 +08:00
zhenyus
df2ab1c3a4 fix: correct config file path in config-checksum annotations for deployment templates
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-27 14:50:08 +08:00
zhenyus
580f3f8d71 feat: add config checksum annotations to deployment templates and update site URL in values files
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-27 14:48:25 +08:00
freeleaps-gitops-bot
1d41f1ba50 ci(bump): bump authentication image version for alpha to snapshot-4dfbab4 2025-03-21 17:16:22 +00:00
zhenyus
6e7417ae00 feat: add migration script and update Helm values for various services with readiness and liveness probes
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-22 01:03:59 +08:00
zhenyus
a90ee717b2 fix: update Prometheus query intervals from 30s to 1m for improved accuracy
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-18 05:59:05 +08:00
zhenyus
336f1fa0e2 fix: remove hardcoded uid values in dashboard templates for consistency
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-18 00:26:16 +08:00
zhenyus
a1ab488cbf fix: update dashboard file names to use dynamic values for consistency
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-18 00:25:04 +08:00
zhenyus
a6803210e0 feat: add dashboard configuration for content, payment, notification, and central storage services
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-18 00:22:06 +08:00
zhenyus
4f8dc21334 fix: correct dashboard metricsPrefix references in expressions for authentication dashboard
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-18 00:15:37 +08:00
zhenyus
fc40481706 fix: update legendFormat syntax for variable interpolation in authentication dashboard
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-18 00:14:42 +08:00
zhenyus
7b4dd7ded7 fix: correct legendFormat syntax for variable interpolation in authentication dashboard
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-18 00:13:34 +08:00
zhenyus
d3e50d6e99 fix: update legendFormat in authentication dashboard for proper variable interpolation
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-18 00:12:55 +08:00
zhenyus
de86687a61 feat: add dashboard configuration for authentication service in values files
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-18 00:10:36 +08:00
zhenyus
56094aa1bd fix: remove version and managed-by labels from service monitor templates for consistency
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-17 23:53:49 +08:00
zhenyus
e8a07a08e6 feat: add metricsEnabled and probesEnabled configuration options to payment, content, centralStorage, authentication, and notification services
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-17 23:51:35 +08:00
zhenyus
96ab638756 fix: remove serviceMonitor.enabled variable from service templates in authentication, centralStorage, content, notification, and payment services
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-17 23:47:29 +08:00
zhenyus
e7bb64108c fix: rename service monitor resources to use a consistent naming convention
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-17 23:45:47 +08:00
zhenyus
bb2bebc164 fix: update service monitor templates to use service-specific values for namespace, labels, interval, and scrapeTimeout
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-17 23:45:16 +08:00
zhenyus
c9cfa0827e fix: update service monitor templates to check individual serviceMonitor.enabled values
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-17 23:42:46 +08:00
zhenyus
4a726cce49 fix: add serviceMonitor configuration to authentication, centralStorage, content, notification, and payment services
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-17 23:40:13 +08:00
zhenyus
32198e2f9a fix: remove port definitions from service monitor configurations
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-17 23:36:46 +08:00
zhenyus
07d4cb7236 fix: update service monitor configurations to use targetPort and remove unnecessary labels
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-17 23:24:26 +08:00
zhenyus
aafbee56f0 fix: uncomment managed-by, version, and name labels in service monitor configuration
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-17 23:18:26 +08:00
zhenyus
1740c2a619 fix: change service monitor port to targetPort in configuration
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-17 23:13:00 +08:00
zhenyus
697b8067c4 fix: correct typo in scrape configuration from 'internal' to 'interval'
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-17 22:56:10 +08:00
zhenyus
6d363c5975 fix: comment out managed-by, version, and name labels in service monitor configuration
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-17 22:54:15 +08:00
zhenyus
413d2ef995 fix: quote service monitor port in authentication service monitor configuration
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-17 22:47:08 +08:00
zhenyus
ae64135a7b feat: configure service monitor port for authentication service
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-17 22:46:23 +08:00
zhenyus
368c726b0b feat: add METRICS_ENABLED and PROBES_ENABLED environment variables to deployment configurations
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-17 22:37:27 +08:00
zhenyus
98bb323798 fix: update service monitor port for authentication metrics endpoint
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-17 22:30:07 +08:00
zhenyus
35406f2f12 feat: add version and name labels to authentication service monitor
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-17 22:25:23 +08:00
zhenyus
aedddf0f96 fix: update periodSeconds for readiness and liveness probes in authentication, centralStorage, content, notification, and payment services
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-17 21:53:50 +08:00
zhenyus
bb30b8ae7c fix: remove terminationGracePeriodSeconds from readiness probe configurations in authentication, centralStorage, content, notification, and payment services
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-17 21:40:03 +08:00
zhenyus
884d1d1784 feat: add httpGet type for readiness and liveness probes in authentication, centralStorage, content, notification, and payment services
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-17 21:38:09 +08:00
zhenyus
83f8b7f030 feat: enable serviceMonitor configuration for authentication, central-storage, content, notification, and payment services
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-17 21:35:31 +08:00
zhenyus
2f8f0a1a1f fix: update probes enabled logic in service configuration templates
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-03-17 21:32:13 +08:00