Commit Graph

859 Commits

Author SHA1 Message Date
吴晟 Wu Sheng 17003ebc16
Rename BanyanDB native TTL doc to Progressive TTL (#12829) 2024-12-05 14:06:56 +08:00
Kemal Beşkardeşler 6252cd49ad
Update SW_STORAGE_ES_RESPONSE_TIMEOUT default value in docs (#12827) 2024-12-04 18:16:00 +08:00
Fine0830 dcc2d15396
Sync UI (#12825) 2024-12-04 10:58:00 +08:00
Wan Kai 1cd5733aac
BanyanDB: Support `@EnableSort` on the column to enable sorting for `IndexRule` and set the default to false. (#12823) 2024-12-03 17:46:33 +08:00
Wan Kai eb4d38c0bb
BanyanDB: Support update the Schema when OAP starting. (#12808) 2024-12-02 12:49:20 +08:00
wuwen f6a821ad48
Improve component-libraries documentation (#12814) 2024-11-30 01:20:22 +08:00
kezhenxu94 b83213705b
Add `doc_values` for fields that need to be sorted or aggregated in ElasticSearch, and disable all others. (#12782) 2024-11-24 12:17:16 +08:00
Zixin Zhou 07a79babc5
Sync UI (#12793) 2024-11-23 21:20:07 +08:00
Gao Hongtao 3cef02ba33
Update banyandb doc (#12792) 2024-11-23 19:46:16 +08:00
Gao Hongtao 10e239f85b
Introduce index mode and refactor banyandb group settings (#12790) 2024-11-22 13:11:30 +08:00
Wan Kai e1698a583f
BanyanDB: Support update the Group settings when OAP starting. (#12780) 2024-11-20 11:29:50 +08:00
kezhenxu94 7e6061a918
Bump up netty to 4.1.115 (#12770) 2024-11-14 15:05:41 +08:00
kezhenxu94 c9a959e50e
Adapt the new metadata standardization in Istio 1.24 (#12768) 2024-11-13 14:41:51 +08:00
Wan Kai 5c5274b93a
Polish mesh data dispatcher: don't generate Instance/Endpoint metrics if they are empty. (#12762) 2024-11-12 15:11:00 +08:00
Wan Kai 9e36eaccb4
UI-templates: topN widget add related trace type and dashboard. (#12758) 2024-11-08 13:50:27 +08:00
Wan Kai 2ed6b58073
Support adding additional attr[0-5] for endpoint level metrics. (#12753) 2024-11-06 12:51:26 +08:00
Gao Hongtao bdd0c92e47
Add batch settings and fix trace query bug (#12749)
Signed-off-by: Gao Hongtao <hanahmily@gmail.com>
2024-11-05 12:05:32 +08:00
吴晟 Wu Sheng 99162eff5d
The index type `BanyanDB.IndexRule.IndexType#TREE` is removed (#12743) 2024-11-04 08:54:51 +08:00
weixiang1862 55600c6672
Add naming control for `EndpointDependencyBuilder`. (#12738) 2024-11-01 18:19:19 +08:00
Wan Kai 39b579f3ae
Add metrics value owner for metrics topN query result (#12737) 2024-11-01 15:30:42 +08:00
zhengziyi0117 9e5fb8f5cf
Support async profiler feature (#12671)
Co-authored-by: zhengziyi <b21080426@njupt.edu.cn>
Co-authored-by: Jiajing LU <lujiajing1126@gmail.com>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2024-10-31 23:09:56 +08:00
mrproliu baa6fcdda8
Reduce Kubernetes metrics calculate in the MQE and Add global widget in Kubernetes Dashboard (#12726) 2024-10-26 19:18:44 +08:00
Wan Kai dc762efc17
Sync UI and fix apdex topn order (#12724) 2024-10-24 18:47:58 +08:00
kezhenxu94 4d2810c4e6
Revert "Add time unit in so11y latency metrics (#12719)" (#12720) 2024-10-24 13:28:25 +08:00
Wan Kai 94d8fef4bc
Add service global topN widget on `General-Root` and `Mesh-Root` dashboard. (#12721) 2024-10-24 11:50:05 +08:00
kezhenxu94 38b775ed2a
Add time unit in so11y latency metrics (#12719) 2024-10-23 17:25:15 +08:00
Wan Kai 80d3e2951d
Support adding additional attr[0-4] for service level metrics. (#12718) 2024-10-23 16:02:06 +08:00
Zixin Zhou b752462193
Sync UI (#12711) 2024-10-18 15:51:12 +08:00
mrproliu dedf1cd9ce
Support the endpoint list widget query with duration parameter. (#12703) 2024-10-17 10:52:03 +08:00
Zixin Zhou bfbda6fa14
Add support Kong monitoring (#12696) 2024-10-17 10:09:10 +08:00
Jay 41b00c866f
Add Component ID for the GoZero framework (#12700) 2024-10-16 16:29:38 +08:00
mrproliu bf9f8aa8be
support query endpoint list with time range (#12693) 2024-10-15 15:17:12 +08:00
kezhenxu94 29618d7f2e
Polish eBPF so11y metrics and add error count for query metrics (#12692) 2024-10-11 22:49:08 +08:00
kezhenxu94 f9d6d950ed
Bump up Apache commons-io to 2.17.0 (#12688) 2024-10-10 08:48:55 +08:00
mrproliu 44e3c34c9c
Reduce the count of process index and adding time range when query process index (#12681) 2024-10-08 21:10:37 +07:00
kezhenxu94 36e34672ed
Add self observability metrics for GraphQL query (#12683) 2024-10-08 20:26:20 +08:00
Wan Kai 1679fa79e1
Fix OTLP metrics incorrectly processed when the datapoint flag is `FLAG_NO_RECORDED_VALUE`. (#12680) 2024-10-08 16:05:22 +08:00
吴晟 Wu Sheng e78dd7c2d8
Released 10.1.0 and start 10.2.0 iteration. (#12669) 2024-09-29 22:44:25 +08:00
Fine0830 da768dcbc2
Sync UI (#12667) 2024-09-29 15:43:48 +08:00
Wan Kai 21e0149474
Support query Alarm message Tag for auto-complete. (#12665) 2024-09-29 11:00:48 +08:00
Wan Kai 690563ee92
PromQL service: support round brackets operator. (#12660) 2024-09-27 21:56:04 +08:00
mrproliu 88f38a41e5
Support to analysis the ztunnel mTLS security policy (#12656) 2024-09-27 16:09:40 +08:00
吴晟 Wu Sheng 29c1b8b457
Optimize `network_address_alias` table to reduce the number of the index. (#12652) 2024-09-27 11:48:48 +08:00
Wan Kai 73c20eedbc
BanyanDB: use `TimestampRange` to improve "events" query for BanyanDB. (#12651) 2024-09-27 10:02:21 +08:00
Wan Kai 74eeb5beee
PromQL service: fix operators result missing `rangeExpression` flag. (#12649) 2024-09-26 15:59:03 +08:00
吴晟 Wu Sheng c5a95ba666
Highlight 10.1 as A Version of PERFORMANCE (#12648) 2024-09-26 13:51:54 +08:00
weixiang1862 3559e85f36
Improve the performance of OTEL metrics handler. (#12645)
Benchmark for a single node k8s monitoring.

| metrics (avg)            | before | after |
| ------------------------ | ------ | ----- |
| cpu                      | 19     | 16    |
| gc count                 | 16     | 1     |
| gc time                  | 38.8   | 5.1   |
| otel metrics latency P50 | 125    | 8     |
| otel metrics latency P90 | 333.3  | 22.5  |
| otel metrics latency P99 | 666.6  | 166.6 |
2024-09-25 18:29:00 +08:00
Wan Kai 9cf79f7282
PromQL service: query API support RFC3399 time format. (#12644) 2024-09-25 13:48:08 +08:00
kezhenxu94 a5d8777ee7
Use CI-friendly revision to set the project version (#12640) 2024-09-24 17:53:14 +08:00
Wan Kai 7d1b65c639
BanyanDB: support TLS connection and configuration. (#12639) 2024-09-24 16:24:17 +08:00
Wan Kai 15ad71d633
BanyanDB: support using native term searching for `keyword` in query `findEndpoint` and `getAlarm`. (#12633) 2024-09-24 14:57:38 +08:00
kezhenxu94 b857fb0091
Bump up protobuf java dependencies to 3.25.5 (#12631) 2024-09-23 11:39:43 +08:00
回村的诱惑 df05b3ddd7
Add Component ID=5022 for GoFrame (#12624) 2024-09-19 00:11:06 +08:00
Chen Ziyan d3f8fe894d
Add SkyWalking Java Agent self observability dashboard (#12622)
* Add SkyWalking Java Agent self observability dashboard.

* add e2e testcase, sync ui, add tips.

* update e2e kafka testcase.
2024-09-16 19:00:35 +08:00
Wan Kai ddbed6d091
Adapt BanyanDB Java Client 0.7.0. (#12621) 2024-09-14 15:05:20 +08:00
mrproliu f8716b49e6
Support to analysis the ztunnel mapped IP address in eBPF Access Log Receiver (#12620) 2024-09-14 14:02:06 +08:00
Fine0830 216c4a2878
sync ui (#12618) 2024-09-13 15:20:32 +08:00
Wan Kai f1aad99e7b
Fix `findEndpoint` query require `keyword` when using BanyanDB. (#12615) 2024-09-13 14:15:20 +08:00
mrproliu 0f79e35283
Fix the previous analysis result missing in the ALS `k8s-mesh` analyzer (#12611) 2024-09-12 12:41:01 +08:00
Wan Kai a71d7ef1f8
Fix query `getGlobalTopology` throw exception when didn't find any services by the given Layer. (#12609) 2024-09-11 14:27:49 +08:00
mrproliu 1ff0c57073
Support service level metrics aggregate when missing pod context in eBPF Access Log Receiver (#12608) 2024-09-10 22:22:19 +08:00
mrproliu a9d6f2ab85
Add `Service`, `ServiceInstance`, `Endpoint` dashboard forwarder to Kubernetes Topologies. (#12604) 2024-09-09 16:23:31 +08:00
kezhenxu94 4f046e7f43
Fix wrong phase of delombok plugin to reduce build warnings (#12599) 2024-09-07 18:44:34 +08:00
kezhenxu94 78483991b7
Add self observability metrics for otel handler (#12598) 2024-09-06 22:01:22 +08:00
kezhenxu94 9d0cb9e28e
Fix wrong health check endpoint to OAP backend (#12597) 2024-09-05 20:12:15 +08:00
Fine0830 87b73cb7f7
sync ui (#12596) 2024-09-05 13:24:49 +08:00
吴晟 Wu Sheng 1ef63347c9
Add one highlight change in 10.1 (#12575) 2024-08-27 22:52:05 +08:00
Fine0830 77cb41b9d3
Sync ui and update license (#12571) 2024-08-26 15:33:11 +08:00
mrproliu a81437f9a6
Update the endpoint name format to `<Method>:<Path>` in eBPF Access Log Receiver. (#12564) 2024-08-23 09:12:05 +08:00
wetool19 ba8c0035cb
Nacos supports configuration context path (#12558) 2024-08-22 19:11:53 +08:00
Fine0830 9e67130587
sync ui (#12559)
* Introduce flame graph to the trace profiling.
* Correct services and instances when changing page numbers.
* Improve metric queries to make page opening brisker.
2024-08-22 18:02:03 +08:00
Wan Kai e704f9b635
Fix the compatibility with Grafana 11 when using label_values query variables. (#12546) 2024-08-20 18:14:54 +08:00
kezhenxu94 9f14c15345
Bump up codeql GHA (#12547) 2024-08-20 11:02:14 +08:00
kezhenxu94 9ba746249a
Fix codeql ci (#12543) 2024-08-19 12:32:06 +08:00
mrproliu 3320bf91ee
Support sort queries on metrics generated by eBPF receiver (#12539) 2024-08-19 09:34:58 +08:00
mrproliu c1a4dc91f6
Get endpoint list order by timestamp desc (#12535) 2024-08-15 10:37:34 +02:00
Wan Kai 85b03402e4
Support async query for the composite GraphQL query. (#12525) 2024-08-13 10:31:04 +02:00
mrproliu 9b17ff1efe
Fix format the endpoint name with empty string (#12508) 2024-08-06 09:52:30 +08:00
kael 5c33ee016d
bug fix: concurrent increase by CounterWindow may cause PriorityQueue broken (#12505) 2024-08-04 20:33:11 +08:00
kezhenxu94 1111f8985d
Bump up infra-e2e GHA (#12506) 2024-08-04 10:13:08 +02:00
mrproliu 7727ef5b7c
Add Unknown Node when receive Kubernetes peer address is not aware in current cluster (#12496) 2024-08-01 16:21:28 +08:00
kezhenxu94 212431e1ed
Bump up graphql-java (#12495) 2024-07-31 14:49:07 +08:00
Fine0830 f3d8a3fb2a
Sync UI (#12489) 2024-07-30 20:58:43 +08:00
Wan Kai 9644f3fda9
BanyanDB: stream sort-by `time` query, use internal time-series rather than `index` to improve the query performance. (#12486) 2024-07-29 22:08:42 +08:00
kezhenxu94 6462436ae9
Add an http endpoint wrapper for health check (#12485) 2024-07-29 15:16:55 +08:00
kezhenxu94 ceaa88f378
Replace workaround with Armeria native supported context path (#12484) 2024-07-28 21:35:38 +08:00
Wan Kai 5441f58f4c
MQE: check the metrics value before do binary operation to improve robustness (#12483) 2024-07-26 18:49:33 +08:00
Chen Ziyan ccb00ab5fd
Fix the mismatch between the unit and calculation of the "Network Bandwidth Usage" widget in Windows-Service Dashboard. (#12477) 2024-07-25 20:37:00 +08:00
Wan Kai 39ee6026f4
BanyanDB: Zipkin Module set service as Entity for improving the query performance (#12474) 2024-07-25 18:27:38 +08:00
吴晟 Wu Sheng ca2b49eab4
Fix words (#12459) 2024-07-16 23:38:17 -07:00
weixiang1862 bd86b262cf
Fix es, mysql, rabbitmq dashboards typos and missing expressions. (#12458) 2024-07-17 13:54:15 +08:00
kezhenxu94 96f44657ad
Push data-generator image to ghcr.io (#12452) 2024-07-15 22:40:54 -07:00
Wan Kai 0949e5a425
Support BanyanDB internal stream query execution tracing (#12439) 2024-07-15 18:36:57 +08:00
mrproliu 5a7c53b1b8
Convert Kubernetes HTTP latency related metrics unit from ns to ms (#12436) 2024-07-13 07:34:48 -07:00
weixiang1862 61b4674c16
Support aggregation operators in PromQL query. (#12431) 2024-07-12 16:29:03 +08:00
Wan Kai 641163cf1d
BanyanDB: fix storage and query Tag autocomplete data (#12432) 2024-07-11 08:19:07 -07:00
Wan Kai 90d5006e89
Support tracing logs query for debugging and add banyandb case for logs e2e. (#12424) 2024-07-09 14:59:11 +08:00
weixiang1862 06cdf991f5
Fix expression of graph `Current QPS` in MySQL dashboard. (#12414) 2024-07-04 16:20:03 +08:00
Wan Kai 98ef399410
Support tracing topology query for debugging (#12413) 2024-07-04 15:09:53 +08:00
吴晟 Wu Sheng fb6f35297b
Polish BanyanDB group and schema creation logic (#12408) 2024-07-03 16:47:53 +08:00
Wan Kai 8b678bebe6
Support BanyanDB internal metrics query execution tracing. (#12400)
* Support BanyanDB internal metrics query execution tracing.
* BanyanDB client config: rise the default `maxBulkSize` to 10000, add `flushTimeout` and set default to 10s.
2024-07-02 18:58:47 +08:00
mrproliu 2e8b4f9917
Support Fetch Cilium Observability data to monitoring Cilium Service network traffic (#12393) 2024-07-02 15:37:42 +08:00
Wan Kai 75fc3e18bf
Fix BanyanDB metrics query: used the wrong `Downsampling` type to find the schema (#12399) 2024-07-02 13:15:46 +08:00
Wan Kai 05373d69d4
Support tracing trace query(SkyWalking and Zipkin) for debugging. (#12378) 2024-06-27 10:12:44 +08:00
shalk(xiao kun) b04fd3c47a
upgrade nacos client from 1.4.2 to 2.3.2 (#12362) 2024-06-26 11:41:34 +08:00
吴晟 Wu Sheng 631161db80
Make more proper histogram buckets in PersistenceTimer. (#12368) 2024-06-24 22:49:21 +08:00
Starry 213077b3ec
Add Python as a supported language for Pulsar (#12365) 2024-06-22 23:55:42 +08:00
Etomy 712a0e7629
Increase `alarm_record#message` column length to 2000 (#12363)
* Increase `alarm_record#message` column length to 2000 from 200.
* Remove `alarm_record#message` column indexing.
2024-06-22 22:50:30 +08:00
Chen Ziyan 84dece92a6
Fix metrics tag in HTTP handler of browser receiver plugin. (#12356) 2024-06-21 19:05:12 +08:00
寻找的人 2603d2bd17
Add component ID(158) for the Solon framework (#12347) 2024-06-20 14:20:05 +08:00
Wan Kai 0b7272d813
Support trace MQE query for debugging. (#12342) 2024-06-18 16:58:03 +08:00
lagagain f91ef23ecd
doc: swap -> virtual memory (#12336) 2024-06-17 08:25:00 +08:00
yswdqz bef9eec44b
[Feature] Support to query relation metrics through PromQL. (#12316) 2024-06-16 14:46:22 +08:00
Wan Kai a6c7c71663
Increase `SW_CORE_GRPC_MAX_MESSAGE_SIZE` to 50MB and e2e bump up the version of the opentelemetry-collector to 0.102.1. (#12321) 2024-06-11 21:14:36 +08:00
吴晟 Wu Sheng caeaec6387
Remove unnecessary BanyanDB flushing logs(info). (#12319) 2024-06-11 12:41:43 +08:00
Starry 905e0a994f
Add Golang as a supported language for Elasticsearch (#12315) 2024-06-11 08:25:21 +08:00
吴晟 Wu Sheng 38ede75f26
Add marketplace docs. (#12317) 2024-06-10 23:23:38 +08:00
mrproliu 0b175ffb0a
Adding eBPF Access Log Feature E2E and support exclude specific namespaces traffic (#12304) 2024-06-06 13:50:10 +08:00
mrproliu 341bdcf1dd
Fix wrong indices in the eBPF Profiling related models (#12297) 2024-06-05 15:52:45 +08:00
吴晟 Wu Sheng ce3361498e
Prepare for 10.0.1 release. (#12265) 2024-05-30 07:14:21 +08:00
Gao Hongtao b21e576a30
Fix Wrong Interval in BanyanDB Installation Process (#12264) 2024-05-29 23:52:13 +08:00
Starry 59824e2cca
Sync UI (#12238) 2024-05-20 08:53:28 +08:00
Calvin Kirs c25cedaaba
minor: Add SBOM to the project. (#12231) 2024-05-16 19:35:24 +08:00
Chen Ziyan 14c5778f57
Add component library IDs of Derby/Sybase/SQLite/DB2/OceanBase jdbc driver (#12208) 2024-05-11 11:51:30 +08:00
weixiang1862 19fba2dae8
Fix LAL test query api. (#12206) 2024-05-10 16:47:24 +08:00
吴晟 Wu Sheng 054d0e4ff9
Release 10.0.0 and move forward to 10.1.0 (#12203) 2024-05-10 09:19:56 +08:00
吴晟 Wu Sheng c3a2368194
Move BanyanDB storage to the recommended storage. (#12202) 2024-05-09 21:32:56 +08:00
Gao Hongtao 28bf55219f
Bump BanyanDB Java Client to 0.6.0 (#12195) 2024-05-09 17:31:52 +08:00
Wan Kai b3044ee714
MQE support `sort_values` and `sort_label_values` functions. (#12193)
* MQE support `sort_values` and `sort_label_values` functions.

* sync UI.
2024-05-07 16:42:14 +08:00
Starry a63601318d
Fix inaccurate Pulsar and Bookkeeper metrics (#12174) 2024-05-01 14:53:33 +08:00
Wan Kai a38628fced
Fix MQE `top_n` global query. (#12163) 2024-04-26 14:53:37 +08:00
Chen Ziyan 9b2cca9b46
add C3P0 in component-libraries.yml (#12162) 2024-04-26 07:53:12 +08:00
Wan Kai fe2c4b5f3f
[Break Change] gGRPC metrics exporter unified the metric value type and support labeled metrics. (#12156) 2024-04-24 14:29:13 +08:00
yswdqz 2d6bc69adb
Optimize OTEL metrics attributes KV convert. (#12152) 2024-04-24 11:32:34 +08:00
yswdqz 86155bef81
Fix inaccurate MySQL/MariaDB, Redis metrics (#12130) 2024-04-22 15:44:12 +08:00
Harry e9a2ed2c03
fix inaccurate Hierarchy of RabbitMQ metrics. (#12144) 2024-04-22 14:55:13 +08:00
Wan Kai 5808627227
* MQE query: make metadata not return `null`. (#12142)
* MQE labeled metrics Binary Operation: return empty value if the labels not match rather than report error.
2024-04-22 12:25:12 +08:00
weixiang1862 d6fc848e8b
Calculate Nginx service HTTP Latency by MQE. (#12136) 2024-04-19 19:12:36 +08:00
Chen Ziyan 7e978261fc
Add ActiveMQ classic monitoring (#12109) 2024-04-18 12:32:59 +08:00
weixiang1862 d71f858f2f
Fix inaccurate MongoDB Metrics & Add label for complex MQE in Nginx dashboard. (#12126) 2024-04-18 11:11:20 +08:00
Wan Kai 630d54d963
Fix hierarchy matching rule and add hierarchy env config and sync UI (#12120) 2024-04-17 12:35:16 +08:00
pg.yang bea7ed3f4a
Fix inaccurate APISIX metrics (#12108) 2024-04-16 17:39:37 +08:00
lagagain d8921d5256
Rename Windows Metrics(swap -> virtual memory) (#12107)
* Fix/Change Windows metrics name(Swap -> Virtual Memory)
  - `memory_swap_free` -> `memory_virtual_memory_free`
  - `memory_swap_total` -> `memory_virtual_memory_total`
  - `memory_swap_percentage` -> `memory_virtual_memory_percentage`
* Fix/Change UI init setting for Windows Swap -> Virtual Memory
* Fix `Memory Swap Usage`/`Virtual Memory Usage` display with UI init.(Linux/Windows)
2024-04-16 08:39:53 +08:00
Fine0830 c551a9ddb6
sync ui (#12102)
* Remove the General metric mode and related logical code.
* Remove metrics for unreal nodes in the topology.
* Enhance the Trace widget for batch consuming spans.
2024-04-15 16:13:49 +08:00
weixiang1862 7a6a19db7f
Aggregate nginx service metrics by using `multiple labels` feature & Remove unused type label in latency metrics. (#12096) 2024-04-12 18:08:07 +08:00
吴晟 Wu Sheng 7701e425d6
Remove `kafka-fetcher/default/createTopicIfNotExist` (#12095) 2024-04-12 10:35:24 +08:00
Wan Kai 13bb3f62a6
Fix not throw error when part of expression not matched any expression node in the `MQE` and `PromQL. (#12093) 2024-04-11 22:50:55 +08:00
吴晟 Wu Sheng f97fd4f6e4
Remove unnecessary `componentIds` as series ID (#12091)
* Remove unnecessary `componentIds` as series ID in the `ServiceRelationClientSideMetrics` and `ServiceRelationServerSideMetrics` entities.
2024-04-11 13:14:06 +08:00
Wan Kai 5a90121c82
Sync UI (#12089) 2024-04-11 10:19:59 +08:00
kezhenxu94 8699ffdf28
Bump up kafka client to fix CVE (#12088) 2024-04-10 22:03:52 +08:00