Commit Graph

114 Commits

Author SHA1 Message Date
freeleaps-gitops-bot
0c004b21bd ci(bump): bump centralStorage image version for alpha to snapshot-812636a 2025-09-19 08:47:33 +00:00
freeleaps-gitops-bot
ebec945769 ci(bump): bump centralStorage image version for prod to 1.7.0 2025-09-19 08:32:19 +00:00
freeleaps-gitops-bot
f2c3556f8e ci(bump): bump centralStorage image version for alpha to snapshot-39d7d2a 2025-09-19 05:30:47 +00:00
freeleaps-gitops-bot
030d9e86e6 ci(bump): bump centralStorage image version for alpha to snapshot-cea1b2c 2025-09-19 03:09:25 +00:00
freeleaps-gitops-bot
97633502fb ci(bump): bump centralStorage image version for alpha to snapshot-38ff0ae 2025-09-18 09:27:12 +00:00
freeleaps-gitops-bot
b6fc60eafd ci(bump): bump centralStorage image version for alpha to snapshot-1baf906 2025-09-18 06:24:16 +00:00
freeleaps-gitops-bot
aab8194c6b ci(bump): bump centralStorage image version for prod to snapshot-4a5bdb4 2025-09-18 04:29:41 +00:00
freeleaps-gitops-bot
407e0f52ce ci(bump): bump centralStorage image version for prod to snapshot-046f9ff 2025-09-05 02:16:14 +00:00
zhenyus
b7908d1692 Refactor configuration files to remove unused fields and add AKV secret management for payment service
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-08-18 21:41:21 +08:00
Nicolas
cd9f42e143 Changed the secret configuration of central storage 2025-08-18 17:38:47 +08:00
Nicolas
69a2c112d1 feat(centralStorage): migrate alpha environment to use Azure Key Vault for sensitive data
- Add FreeleapsSecret configuration for Azure Key Vault integration
- Move sensitive data (mongodbUri, azureStorageDocumentApiKey, azureStorageDocumentApiEndpoint) from config to secrets
- Update deployment template to read from both config and FreeleapsSecret
- Comment out sensitive fields in central-storage-config.yaml
- Create freeleapssecret.yaml template for secret management
2025-08-18 16:24:11 +08:00
freeleaps-gitops-bot
c8c9eb33a4 ci(bump): bump centralStorage image version for prod to snapshot-c93ce6b 2025-08-12 05:07:32 +00:00
freeleaps-gitops-bot
4bc4d79a54 ci(bump): bump centralStorage image version for prod to 1.4.0 2025-08-12 04:37:17 +00:00
freeleaps-gitops-bot
3f0a26819f ci(bump): bump centralStorage image version for prod to snapshot-804c71f 2025-08-12 04:37:07 +00:00
freeleaps-gitops-bot
8517eb7257 ci(bump): bump centralStorage image version for prod to snapshot-c8a6275 2025-08-11 01:40:45 +00:00
freeleaps-gitops-bot
a5d851f069 ci(bump): bump centralStorage image version for prod to 1.3.1 2025-08-11 01:35:50 +00:00
b797f17816 Merge pull request 'feat: enable log ingest for central storage in prod environment' (#62) from Nicolas_local_ops into master
Reviewed-on: https://gitea.freeleaps.mathmast.com/freeleaps/freeleaps-ops/pulls/62
2025-08-08 02:32:13 +00:00
Nicolas
71283aa2da feat: enable log ingest for central storage in prod environment 2025-08-08 10:31:22 +08:00
freeleaps-gitops-bot
1b264fd54c ci(bump): bump centralStorage image version for prod to snapshot-bbfc1ba 2025-08-07 01:10:54 +00:00
freeleaps-gitops-bot
e47a55fa4b ci(bump): bump centralStorage image version for prod to 1.3.0 2025-08-07 01:04:24 +00:00
cb70534764 Merge pull request 'fix: remove invalid k8scluster receiver to resolve OpenTelemetry startup error' (#43) from Nicolas_local_ops into master
Reviewed-on: https://gitea.freeleaps.mathmast.com/freeleaps/freeleaps-ops/pulls/43
2025-08-01 00:27:30 +00:00
Nicolas
aa74f6a4f7 fix: remove invalid k8scluster receiver to resolve OpenTelemetry startup error
- Remove k8scluster receiver (invalid type name)
- Remove unused otlp receiver definitions
- Keep only filelog receiver which is actually used in pipeline
- Fixes CrashLoopBackOff issue in central-storage pod
2025-08-01 07:52:37 +08:00
freeleaps-gitops-bot
b85b73c9b2 ci(bump): bump centralStorage image version for alpha to snapshot-12a0d9a 2025-07-31 15:26:49 +00:00
80773c8c82 Merge pull request 'Nicolas_local_ops' (#42) from Nicolas_local_ops into master
Reviewed-on: https://gitea.freeleaps.mathmast.com/freeleaps/freeleaps-ops/pulls/42
2025-07-31 15:20:01 +00:00
Nicolas
d85f9408e4 fix: change Chinese comments to English in OpenTelemetry configs
- Replace Chinese comments with English in opentelemetry.yaml files
- Maintain consistent English-only comments in freeleaps-ops repository
- Keep the same functionality while improving code readability
2025-07-31 23:17:45 +08:00
Nicolas
5101e6d2cd fix: optimize OpenTelemetry configuration to prevent duplicate log collection
- Change receivers from [filelog, otlp, k8scluster] to [filelog] only
- Prevent duplicate logs from multiple collection sources
- Keep only filelog receiver to collect logs from application log files
- This eliminates duplicate logs appearing in Grafana for devsvc and central-storage
2025-07-31 23:08:10 +08:00
3092ad0fa1 Merge pull request 'Nicolas_local_ops' (#40) from Nicolas_local_ops into master
Reviewed-on: https://gitea.freeleaps.mathmast.com/freeleaps/freeleaps-ops/pulls/40
2025-07-31 03:33:08 +00:00
Nicolas
cc73ad92a9 feat: add container logs collection to OpenTelemetry config for central storage 2025-07-31 11:27:28 +08:00
8d55c49660 Merge pull request 'fix: use hasKey to safely check for logIngest.persistence existence' (#39) from Nicolas_local_ops into master
Reviewed-on: https://gitea.freeleaps.mathmast.com/freeleaps/freeleaps-ops/pulls/39
2025-07-31 02:22:46 +00:00
Nicolas
da7e43547f fix: use hasKey to safely check for logIngest.persistence existence 2025-07-31 10:21:50 +08:00
7f7bbfd6d4 Merge pull request 'fix: add default values for logIngest.persistence to prevent nil pointer errors' (#38) from Nicolas_local_ops into master
Reviewed-on: https://gitea.freeleaps.mathmast.com/freeleaps/freeleaps-ops/pulls/38
2025-07-31 02:20:11 +00:00
Nicolas
85fa39f8e2 fix: add default values for logIngest.persistence to prevent nil pointer errors 2025-07-31 10:18:47 +08:00
a2ffc1ea4d Merge pull request 'fix: optimize central storage logging configuration to resolve hourly log bursts' (#37) from Nicolas_local_ops into master
Reviewed-on: https://gitea.freeleaps.mathmast.com/freeleaps/freeleaps-ops/pulls/37
2025-07-31 02:16:06 +00:00
Nicolas
7a7fcf1398 fix: optimize central storage logging configuration to resolve hourly log bursts
- Change start_at from beginning to end to avoid historical log duplication
- Add poll_interval: 1s for real-time file monitoring
- Optimize batch processing: send_batch_size: 1, timeout: 1s
- Add PVC template for log persistence to reduce log loss risk
- Update deployment to support persistent volume for logs
2025-07-31 10:14:55 +08:00
freeleaps-gitops-bot
184eba16ed ci(bump): bump centralStorage image version for alpha to snapshot-311fd21 2025-07-29 10:30:27 +00:00
Nicolas
f9c2c7e696 Change OTC start_at to beginning to read existing logs 2025-07-29 18:04:53 +08:00
Nicolas
401a2166cd Simplify OTC config: remove timestamp parsing to fix startup issues 2025-07-29 17:57:30 +08:00
Nicolas
7ae5966da1 Fix timestamp parsing: use move operator to extract timestamp from attributes 2025-07-29 17:54:25 +08:00
Nicolas
12a7f1b98c Fix timestamp parsing in OTC config for central-storage logs 2025-07-29 17:40:57 +08:00
Nicolas
c4bd3df730 Fix OTLP exporter config: remove unsupported labels options 2025-07-29 17:22:40 +08:00
Nicolas
18eb4df3fb Revert to OTLP config to fix OTC startup - will investigate Loki config later 2025-07-29 17:16:46 +08:00
Nicolas
d234716697 Comment out Loki labels config to fix OTC startup - can be enabled later 2025-07-29 17:13:01 +08:00
Nicolas
b1c9f59cff Simplify Loki exporter configuration to fix OTC startup issues 2025-07-29 17:08:32 +08:00
Nicolas
a1d5652efb Fix Loki exporter configuration: remove invalid keys 2025-07-29 17:05:24 +08:00
Nicolas
b7b6ddcae4 Fix central-storage logging: change OTLP exporter to Loki HTTP exporter 2025-07-29 16:47:47 +08:00
Nicolas
acd5379c27 fix: restore json_parser with timestamp parsing based on local testing 2025-07-29 15:40:26 +08:00
Nicolas
beab7cd117 fix: remove all parsing operators to use raw log content 2025-07-29 15:29:53 +08:00
Nicolas
37db3b4404 fix: remove time_parser to use default timestamp handling 2025-07-29 14:46:13 +08:00
Nicolas
5479b85968 fix: separate timestamp parsing from json_parser to resolve time parsing error 2025-07-29 14:42:29 +08:00
afb02b4e0c Merge branch 'master' into Nicolas_local_ops 2025-07-29 06:33:15 +00:00