Commit Graph

1994 Commits

Author SHA1 Message Date
weixiang1862 2c6b1b3e5a
Optimize metrics cache loading when trace latency greater than cache timeout (#13068) 2025-02-26 16:26:40 +08:00
Wan Kai 23c2806eca
count watermark circuit break/recover in the query time window (#13062) 2025-02-21 15:57:28 +08:00
吴晟 Wu Sheng d98f74d0f0
Add more clear logs when oap-cluster-internal data format is inconcsistent (#13059) 2025-02-21 12:41:08 +08:00
mrproliu c09d9394a7
Add SkyPredictor project to E2E Testing alarm with baseline (#13047) 2025-02-20 16:42:03 +08:00
吴晟 Wu Sheng cd953b6290
Prevent traffic metrics inconsistent between in-memory and database server. (#13045) 2025-02-19 18:26:07 +08:00
mrproliu 7785c4164b
Move `metrics-baseline` into `ai-pipeline` module (#13041) 2025-02-18 20:16:14 +08:00
mrproliu 68ab2edd77
Update browser perf calculate strategy (#13034) 2025-02-13 16:36:07 +08:00
Wan Kai 0cd43544e5
Add `Get Alarm Runtime Status` API. (#13028) 2025-02-12 23:22:47 +08:00
Wan Kai 97c47de89b
Baseline: Support query baseline with MQE and use in the Alarm Kernel. (#13024) 2025-02-10 20:35:30 +08:00
kezhenxu94 217f2d55c3
fix: Envoy logs conversion error (#13019) 2025-02-05 15:58:36 +08:00
吴晟 Wu Sheng 44844dd802
Add `Get Node List in the Cluster` API (#13015) 2025-02-01 16:28:10 +08:00
mrproliu 302b365681
Predicted value level declaration in baseline module (#13014) 2025-01-27 22:13:23 +11:00
mrproliu 8ebb52dd19
Adapt new Browser data upload protocol (#13009) 2025-01-24 16:41:30 +10:00
mrproliu f5b94632ae
Adapt query supported metrics names in Baseline (#13007) 2025-01-23 16:37:33 +11:00
Wan Kai 5aaf8326cd
BaseLine proto: Add query baseline supported metrics names. (#13005) 2025-01-22 20:51:06 +11:00
mrproliu 8fbc1eb95a
Add Baseline module for support alarm module query predict metrics value (#12991) 2025-01-17 23:01:09 +11:00
Wan Kai 0d7c7873f0
OAP self observability: Add watermark circuit break/recover metrics. (#12981) 2025-01-16 20:32:02 +08:00
吴晟 Wu Sheng dc33a6e80a
Fix missing limit in UI template query (#12980) 2025-01-16 14:00:54 +08:00
Zixin Zhou 3914802248
Update component IDs for Ruby (#12977) 2025-01-15 23:32:39 +08:00
Wan Kai 8e51a87197
OAP Self observability: Add JVM heap and direct memory used metrics. (#12974) 2025-01-15 19:06:46 +08:00
吴晟 Wu Sheng 6f8941a9d3
Fix bugs and enhance RESOURCE EXHAUSTED: Watermark exceeded logs. (#12973)
1. Fix too many `RESOURCE EXHAUSTED: Watermark exceeded` when other nodes reached limitations.
2. Fix bug of watermark exceeded recovery.
3. Change the default memory usage limitation to 96%.
4. Fix WatermarkListener name is not set.
2025-01-15 16:09:33 +08:00
Wan Kai 8bcaabb43c
MQE: Support `&&(and)`, `||(or)` bool operators. (#12965) 2025-01-14 16:22:29 +08:00
吴晟 Wu Sheng d447c4534f
Make bydb depdendencies file checked and consistent. (#12961) 2025-01-13 17:47:15 +08:00
吴晟 Wu Sheng ca5c8b29e1
BanyanDB: Add support for compatibility checks based on API version (#12959) 2025-01-12 21:34:51 +08:00
吴晟 Wu Sheng d12c6b5979
Add circuit-breaking mechanism (#12953) 2025-01-10 23:49:05 +08:00
peachisai f64223340c
Remove redundant code (#12944) 2025-01-10 13:26:54 +08:00
mrproliu 3232b54752
Support new browser metrics upload API (#12948) 2025-01-09 21:52:20 +08:00
mrproliu 3c52eedd04
Support `labelAvg` function in the OAL engine (#12940) 2025-01-08 20:56:06 +08:00
Wan Kai 0a0890c148
MQE: Support `top_n_of` function for merging multiple metrics topn query. (#12937) 2025-01-08 12:53:34 +08:00
Gao Hongtao c6ef231f39
Support BanyanDB's new property (#12936) 2025-01-08 11:56:45 +08:00
吴晟 Wu Sheng 844aa5084d
Add more comments for IndexMode (#12930) 2025-01-05 11:01:16 +08:00
吴晟 Wu Sheng 776a757fa8
* Fix wrong index mode declarations
* Remove `@BanyanDB.IndexMode` from TopN implementation, as it's not necessary. Those are records, not metrics.
* Fix, move `Service`, `Instance`, `Endpoint` and `Process` relations out of `index-mode`, as they are time series.
2025-01-05 09:26:19 +08:00
吴晟 Wu Sheng fcb08aceab
Fix `AvgHistogramPercentileFunction` doesn't have proper field definition for `ranks`. (#12927) 2025-01-04 22:38:34 +08:00
吴晟 Wu Sheng 5ab39acd96
Add `bydb.dependencies.properties` config file (#12922) 2025-01-02 16:56:54 +08:00
Wan Kai 1a1454e922
storage e2e: make topn result more predictable (#12921) 2025-01-02 12:12:26 +08:00
吴晟 Wu Sheng 5be35ba774
[Breaking Change] Remove H2 as storage option permanently. (#12909)
Remove H2 as storage option permanently. BanyanDB 0.8(OAP 10.2 required) is easy, stable and production-ready. Don't need H2 as default storage anymore.
2024-12-30 21:07:21 +08:00
Wan Kai d3d3ee8abd
Alarm: Support store and query the metrics snapshot when the alarm is triggered (#12910) 2024-12-30 10:57:00 +08:00
Zixin Zhou f8f5fa5206
Add component ID for Caffeine (#12906) 2024-12-28 16:34:25 +08:00
Zixin Zhou 559f770ee9
Add Ruby component IDs (#12900) 2024-12-26 18:55:57 +08:00
weixiang1862 66201c9253
Add protection for dynamic config change propagate chain. (#12899) 2024-12-26 18:08:05 +08:00
mrproliu 3601ba14d4
Add ITVersion for helping management the versions in IT (#12895) 2024-12-23 20:49:09 +08:00
吴晟 Wu Sheng 82967c9e9a
Bump up DB commit to lower e2e/IT CPU costs (#12888)
* Bump up DB commit to lower e2e/IT CPU costs

* Bump banyandb

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

---------

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>
Co-authored-by: Gao Hongtao <hanahmily@gmail.com>
2024-12-23 15:11:13 +08:00
weixiang1862 6d262cce62
Fix `ServerStatusService.statusWatchers` concurrent modification. (#12884) 2024-12-20 20:45:00 +08:00
Wan Kai e0d64112bc
Add IT for BanyanDB schema install and update. (#12879) 2024-12-18 16:59:35 +08:00
吴晟 Wu Sheng 841a92b621
Support `Get Effective TTL Configurations` API. (#12847)
* [Breaking Change] Rename `debugging-query` module to `status-query` module. Relative exposed APIs are **UNCHANGED**. 
* Support `Get Effective TTL Configurations` API.
2024-12-12 09:51:47 +08:00
吴晟 Wu Sheng ab943969a5
Remove one unused method. (#12840) 2024-12-09 10:31:38 +08:00
Wan Kai 1cd5733aac
BanyanDB: Support `@EnableSort` on the column to enable sorting for `IndexRule` and set the default to false. (#12823) 2024-12-03 17:46:33 +08:00
zhengziyi0117 88cd1eb025
fix async profiler task query && Bump up UI (#12821) 2024-12-03 17:09:01 +08:00
zhengziyi0117 f00827795e
feat: Replace timestamps with Duration in async profiler query && Add AsyncProfiling widget (#12816) 2024-12-02 14:13:28 +08:00
Wan Kai eb4d38c0bb
BanyanDB: Support update the Schema when OAP starting. (#12808) 2024-12-02 12:49:20 +08:00
wuwen f6a821ad48
Improve component-libraries documentation (#12814) 2024-11-30 01:20:22 +08:00
kezhenxu94 b83213705b
Add `doc_values` for fields that need to be sorted or aggregated in ElasticSearch, and disable all others. (#12782) 2024-11-24 12:17:16 +08:00
Gao Hongtao 3cef02ba33
Update banyandb doc (#12792) 2024-11-23 19:46:16 +08:00
Gao Hongtao 10e239f85b
Introduce index mode and refactor banyandb group settings (#12790) 2024-11-22 13:11:30 +08:00
Wan Kai e1698a583f
BanyanDB: Support update the Group settings when OAP starting. (#12780) 2024-11-20 11:29:50 +08:00
zhengziyi0117 f230947ddb
Improve JFR async profiler parser (#12777) 2024-11-18 19:42:40 +08:00
Tsonglew b6d1190cfe
Add gRPC to Component Libraries (#12778) 2024-11-18 14:16:37 +08:00
kezhenxu94 7e6061a918
Bump up netty to 4.1.115 (#12770) 2024-11-14 15:05:41 +08:00
kezhenxu94 c9a959e50e
Adapt the new metadata standardization in Istio 1.24 (#12768) 2024-11-13 14:41:51 +08:00
Wan Kai 5c5274b93a
Polish mesh data dispatcher: don't generate Instance/Endpoint metrics if they are empty. (#12762) 2024-11-12 15:11:00 +08:00
Wan Kai 9e36eaccb4
UI-templates: topN widget add related trace type and dashboard. (#12758) 2024-11-08 13:50:27 +08:00
Wan Kai 2ed6b58073
Support adding additional attr[0-5] for endpoint level metrics. (#12753) 2024-11-06 12:51:26 +08:00
Gao Hongtao bdd0c92e47
Add batch settings and fix trace query bug (#12749)
Signed-off-by: Gao Hongtao <hanahmily@gmail.com>
2024-11-05 12:05:32 +08:00
吴晟 Wu Sheng 99162eff5d
The index type `BanyanDB.IndexRule.IndexType#TREE` is removed (#12743) 2024-11-04 08:54:51 +08:00
weixiang1862 55600c6672
Add naming control for `EndpointDependencyBuilder`. (#12738) 2024-11-01 18:19:19 +08:00
Wan Kai 39b579f3ae
Add metrics value owner for metrics topN query result (#12737) 2024-11-01 15:30:42 +08:00
zhengziyi0117 9e5fb8f5cf
Support async profiler feature (#12671)
Co-authored-by: zhengziyi <b21080426@njupt.edu.cn>
Co-authored-by: Jiajing LU <lujiajing1126@gmail.com>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2024-10-31 23:09:56 +08:00
Wan Kai 3ecffd6e65
TopN query attrs filter support not equal. (#12730) 2024-10-30 17:22:54 +08:00
Wan Kai 8b6cd1c241
Add more attrs for Service metrics (#12728) 2024-10-29 15:07:53 +08:00
Wan Kai 25b2be13af
Optimize the error message when decorator names conflict. (#12727) 2024-10-28 09:42:16 +08:00
mrproliu baa6fcdda8
Reduce Kubernetes metrics calculate in the MQE and Add global widget in Kubernetes Dashboard (#12726) 2024-10-26 19:18:44 +08:00
Wan Kai dc762efc17
Sync UI and fix apdex topn order (#12724) 2024-10-24 18:47:58 +08:00
kezhenxu94 4d2810c4e6
Revert "Add time unit in so11y latency metrics (#12719)" (#12720) 2024-10-24 13:28:25 +08:00
Wan Kai 94d8fef4bc
Add service global topN widget on `General-Root` and `Mesh-Root` dashboard. (#12721) 2024-10-24 11:50:05 +08:00
kezhenxu94 38b775ed2a
Add time unit in so11y latency metrics (#12719) 2024-10-23 17:25:15 +08:00
Wan Kai 80d3e2951d
Support adding additional attr[0-4] for service level metrics. (#12718) 2024-10-23 16:02:06 +08:00
Zixin Zhou b752462193
Sync UI (#12711) 2024-10-18 15:51:12 +08:00
Zixin Zhou bfbda6fa14
Add support Kong monitoring (#12696) 2024-10-17 10:09:10 +08:00
Jay 41b00c866f
Add Component ID for the GoZero framework (#12700) 2024-10-16 16:29:38 +08:00
mrproliu bf9f8aa8be
support query endpoint list with time range (#12693) 2024-10-15 15:17:12 +08:00
kezhenxu94 29618d7f2e
Polish eBPF so11y metrics and add error count for query metrics (#12692) 2024-10-11 22:49:08 +08:00
kezhenxu94 97d4a59588
Add GraphQL metrics dashboard (#12687) 2024-10-09 22:54:31 +08:00
mrproliu 44e3c34c9c
Reduce the count of process index and adding time range when query process index (#12681) 2024-10-08 21:10:37 +07:00
kezhenxu94 180ca71375
Fix checking OTEL DataPointFlags (#12682) 2024-10-08 20:59:42 +08:00
kezhenxu94 36e34672ed
Add self observability metrics for GraphQL query (#12683) 2024-10-08 20:26:20 +08:00
Wan Kai 1679fa79e1
Fix OTLP metrics incorrectly processed when the datapoint flag is `FLAG_NO_RECORDED_VALUE`. (#12680) 2024-10-08 16:05:22 +08:00
Wan Kai 21e0149474
Support query Alarm message Tag for auto-complete. (#12665) 2024-09-29 11:00:48 +08:00
Wan Kai 690563ee92
PromQL service: support round brackets operator. (#12660) 2024-09-27 21:56:04 +08:00
mrproliu 88f38a41e5
Support to analysis the ztunnel mTLS security policy (#12656) 2024-09-27 16:09:40 +08:00
吴晟 Wu Sheng 29c1b8b457
Optimize `network_address_alias` table to reduce the number of the index. (#12652) 2024-09-27 11:48:48 +08:00
Wan Kai 73c20eedbc
BanyanDB: use `TimestampRange` to improve "events" query for BanyanDB. (#12651) 2024-09-27 10:02:21 +08:00
Wan Kai 74eeb5beee
PromQL service: fix operators result missing `rangeExpression` flag. (#12649) 2024-09-26 15:59:03 +08:00
weixiang1862 3559e85f36
Improve the performance of OTEL metrics handler. (#12645)
Benchmark for a single node k8s monitoring.

| metrics (avg)            | before | after |
| ------------------------ | ------ | ----- |
| cpu                      | 19     | 16    |
| gc count                 | 16     | 1     |
| gc time                  | 38.8   | 5.1   |
| otel metrics latency P50 | 125    | 8     |
| otel metrics latency P90 | 333.3  | 22.5  |
| otel metrics latency P99 | 666.6  | 166.6 |
2024-09-25 18:29:00 +08:00
Wan Kai 9cf79f7282
PromQL service: query API support RFC3399 time format. (#12644) 2024-09-25 13:48:08 +08:00
kezhenxu94 a5d8777ee7
Use CI-friendly revision to set the project version (#12640) 2024-09-24 17:53:14 +08:00
Wan Kai 7d1b65c639
BanyanDB: support TLS connection and configuration. (#12639) 2024-09-24 16:24:17 +08:00
Wan Kai 15ad71d633
BanyanDB: support using native term searching for `keyword` in query `findEndpoint` and `getAlarm`. (#12633) 2024-09-24 14:57:38 +08:00
Wan Kai c4ab0b5981
chore: clean codes (#12628) 2024-09-20 09:40:17 +08:00
回村的诱惑 df05b3ddd7
Add Component ID=5022 for GoFrame (#12624) 2024-09-19 00:11:06 +08:00
Chen Ziyan d3f8fe894d
Add SkyWalking Java Agent self observability dashboard (#12622)
* Add SkyWalking Java Agent self observability dashboard.

* add e2e testcase, sync ui, add tips.

* update e2e kafka testcase.
2024-09-16 19:00:35 +08:00