Commit Graph

735 Commits

Author SHA1 Message Date
Chen Ziyan 14c5778f57
Add component library IDs of Derby/Sybase/SQLite/DB2/OceanBase jdbc driver (#12208) 2024-05-11 11:51:30 +08:00
weixiang1862 19fba2dae8
Fix LAL test query api. (#12206) 2024-05-10 16:47:24 +08:00
吴晟 Wu Sheng 054d0e4ff9
Release 10.0.0 and move forward to 10.1.0 (#12203) 2024-05-10 09:19:56 +08:00
吴晟 Wu Sheng c3a2368194
Move BanyanDB storage to the recommended storage. (#12202) 2024-05-09 21:32:56 +08:00
Gao Hongtao 28bf55219f
Bump BanyanDB Java Client to 0.6.0 (#12195) 2024-05-09 17:31:52 +08:00
Wan Kai b3044ee714
MQE support `sort_values` and `sort_label_values` functions. (#12193)
* MQE support `sort_values` and `sort_label_values` functions.

* sync UI.
2024-05-07 16:42:14 +08:00
Starry a63601318d
Fix inaccurate Pulsar and Bookkeeper metrics (#12174) 2024-05-01 14:53:33 +08:00
Wan Kai a38628fced
Fix MQE `top_n` global query. (#12163) 2024-04-26 14:53:37 +08:00
Chen Ziyan 9b2cca9b46
add C3P0 in component-libraries.yml (#12162) 2024-04-26 07:53:12 +08:00
Wan Kai fe2c4b5f3f
[Break Change] gGRPC metrics exporter unified the metric value type and support labeled metrics. (#12156) 2024-04-24 14:29:13 +08:00
yswdqz 2d6bc69adb
Optimize OTEL metrics attributes KV convert. (#12152) 2024-04-24 11:32:34 +08:00
yswdqz 86155bef81
Fix inaccurate MySQL/MariaDB, Redis metrics (#12130) 2024-04-22 15:44:12 +08:00
Harry e9a2ed2c03
fix inaccurate Hierarchy of RabbitMQ metrics. (#12144) 2024-04-22 14:55:13 +08:00
Wan Kai 5808627227
* MQE query: make metadata not return `null`. (#12142)
* MQE labeled metrics Binary Operation: return empty value if the labels not match rather than report error.
2024-04-22 12:25:12 +08:00
weixiang1862 d6fc848e8b
Calculate Nginx service HTTP Latency by MQE. (#12136) 2024-04-19 19:12:36 +08:00
Chen Ziyan 7e978261fc
Add ActiveMQ classic monitoring (#12109) 2024-04-18 12:32:59 +08:00
weixiang1862 d71f858f2f
Fix inaccurate MongoDB Metrics & Add label for complex MQE in Nginx dashboard. (#12126) 2024-04-18 11:11:20 +08:00
Wan Kai 630d54d963
Fix hierarchy matching rule and add hierarchy env config and sync UI (#12120) 2024-04-17 12:35:16 +08:00
pg.yang bea7ed3f4a
Fix inaccurate APISIX metrics (#12108) 2024-04-16 17:39:37 +08:00
lagagain d8921d5256
Rename Windows Metrics(swap -> virtual memory) (#12107)
* Fix/Change Windows metrics name(Swap -> Virtual Memory)
  - `memory_swap_free` -> `memory_virtual_memory_free`
  - `memory_swap_total` -> `memory_virtual_memory_total`
  - `memory_swap_percentage` -> `memory_virtual_memory_percentage`
* Fix/Change UI init setting for Windows Swap -> Virtual Memory
* Fix `Memory Swap Usage`/`Virtual Memory Usage` display with UI init.(Linux/Windows)
2024-04-16 08:39:53 +08:00
Fine0830 c551a9ddb6
sync ui (#12102)
* Remove the General metric mode and related logical code.
* Remove metrics for unreal nodes in the topology.
* Enhance the Trace widget for batch consuming spans.
2024-04-15 16:13:49 +08:00
weixiang1862 7a6a19db7f
Aggregate nginx service metrics by using `multiple labels` feature & Remove unused type label in latency metrics. (#12096) 2024-04-12 18:08:07 +08:00
吴晟 Wu Sheng 7701e425d6
Remove `kafka-fetcher/default/createTopicIfNotExist` (#12095) 2024-04-12 10:35:24 +08:00
Wan Kai 13bb3f62a6
Fix not throw error when part of expression not matched any expression node in the `MQE` and `PromQL. (#12093) 2024-04-11 22:50:55 +08:00
吴晟 Wu Sheng f97fd4f6e4
Remove unnecessary `componentIds` as series ID (#12091)
* Remove unnecessary `componentIds` as series ID in the `ServiceRelationClientSideMetrics` and `ServiceRelationServerSideMetrics` entities.
2024-04-11 13:14:06 +08:00
Wan Kai 5a90121c82
Sync UI (#12089) 2024-04-11 10:19:59 +08:00
kezhenxu94 8699ffdf28
Bump up kafka client to fix CVE (#12088) 2024-04-10 22:03:52 +08:00
kezhenxu94 f5cd798185
Fix `NullPointerException` in Istio ServiceEntry registry (#12087) 2024-04-10 20:43:01 +08:00
Wan Kai bbbed44863
[Break Change]: Labeled Metrics support multiple labels. (#12082) 2024-04-10 19:57:36 +08:00
kezhenxu94 c79423c358
Bump up dependencies to fix CVEs (#12080) 2024-04-09 17:25:15 +08:00
Starry 48c96a2331
Sync UI (#12076) 2024-04-06 21:30:49 +08:00
吴晟 Wu Sheng 3794b3dc91
Add a FAQ about other storage options. (#12059) 2024-03-29 11:55:18 +08:00
Wan Kai b6d8d3a174
Fix `AvgHistogramPercentileFunction` legacy name. (#12039) 2024-03-19 09:42:14 +08:00
Gao Hongtao 3f4126a28a
Refactor data-generator to support generating metrics (#12031) 2024-03-17 23:07:03 +08:00
SheltonZSL 935ab0b17d
Display the port services listen to from OAP and UI (#12030) 2024-03-17 21:58:40 +08:00
Starry 8a4585ceec
Add Golang as a supported language for Kafka (#12027) 2024-03-16 22:24:08 +08:00
mrproliu 8fad0cc8a8
Adding more access log metrics into k8s dashboards (#12018) 2024-03-14 21:52:21 +08:00
kezhenxu94 52d5b2573c
Add doc of one-line quick start script for different storage types (#12014) 2024-03-14 11:55:34 +08:00
吴晟 Wu Sheng 60a58b4598
Remove `OpenTelemetry Exporter` support from meter doc (#12009) 2024-03-13 16:07:18 +08:00
kezhenxu94 0fad582280
Add BanyanDB to docker-compose quickstart (#12006) 2024-03-12 16:37:52 +08:00
吴晟 Wu Sheng 8c16fdd816
Fix chores (#12000) 2024-03-08 14:07:26 +08:00
Starry c5e0f5f5a6
Add hierarchy for Pulsar (#11971) 2024-03-08 09:34:03 +08:00
Chen Ziyan 00ccaceb27
Support ClickHouse server monitoring & Support service hierarchy (#11966) 2024-03-07 09:41:39 +08:00
peachisai 5fe4f491dc
Add Kafka hierarchy (#11954) 2024-03-04 14:13:27 +08:00
Wan Kai 80bf5d360c
Remove Column#function mechanism in the kernel and make query `readMetricValue` always return the average value of the duration. (#11976) 2024-03-04 09:56:59 +08:00
Wan Kai 40f160cf9a
Fix query-protocol.md, make it consistent with the GraphQL query protocol. (#11950) 2024-02-28 15:31:05 +08:00
Wan Kai ddd7ff5e1f
Fix kafka topic name in exporter doc. (#11948) 2024-02-28 10:29:43 +08:00
吴晟 Wu Sheng a65a6e0ff2
Remove CLI(`swctl`) from the image. (#11940) 2024-02-27 14:57:57 +08:00
peachisai eb071e49df
Add hierarchy for RabbitMQ (#11935)
Co-authored-by: 邵一鸣 <shaoym02@vanke.com>
Co-authored-by: Wan Kai <wankai123@foxmail.com>
2024-02-27 12:18:36 +08:00
Starry f006edd158
Add Golang as a supported language for Pulsar (#11937) 2024-02-27 09:00:32 +08:00
吴晟 Wu Sheng fc9d9acba4
Sync UI (#11934) 2024-02-26 21:39:26 +08:00
吴晟 Wu Sheng 6b49098aed
Upgrade PostgreSQL driver to `42.4.4` to fix CVE-2024-1597. (#11922) 2024-02-24 12:10:59 +08:00
Wan Kai 30748d2052
Fix Service Layer when building Events in the EventHookCallback. (#11918) 2024-02-23 14:01:55 +08:00
ooi22 8737725624
Modifying the limit size of DCS gRPC inbound message (#11892) 2024-02-23 08:54:45 +08:00
Chen Ziyan 0f7844278a
Fix day-based table rolling time range strategy in JDBC storage. (#11915) 2024-02-22 23:15:38 +08:00
吴晟 Wu Sheng 00f1521460
Add `OpenTelemetry SkyWalking Exporter` deprecated warning doc. (#11909) 2024-02-22 08:57:39 +08:00
Wan Kai a41bd6eddd
Mock `/api/v1/status/buildinfo` for PromQL API (#11901) 2024-02-20 19:21:22 +08:00
Chen Ziyan a61b3bb1f7
Fix table exists check in the JDBC Storage Plugin. (#11897) 2024-02-20 15:01:11 +08:00
weixiang1862 a471b85ac2
Fix ServiceInstance `in` query. (#11888) 2024-02-19 16:20:45 +08:00
peachisai 48c766ee01
Support RocketMQ monitoring (#11758)
* Support RocketMQ monitoring
* Add swip3 - RocketMQ monitoring
* Add RocketMQ e2e cases

---------

Co-authored-by: peachisai <497533062@qq.com>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: 邵一鸣 <shaoym02@vanke.com>
Co-authored-by: Wan Kai <wankai123@foxmail.com>
2024-02-18 07:17:20 +08:00
Starry b775e7f547
Add Golang as a supported language for RocketMQ (#11877) 2024-02-13 17:04:15 +11:00
peachisai a688500fb4
Add `count` aggregation function for MAL (#11869)
Co-authored-by: Wan Kai <wankai123@foxmail.com>
2024-02-06 10:48:51 +08:00
Wan Kai 78d9e33f10
Add hierarchy relations auto-matching for NGINX/APISIX. (#11870)
Fix `Nginx-Instance` metrics to instance level.
2024-02-05 18:59:31 +08:00
kezhenxu94 d0e1daa6a2
Switch macOS runner to m1 (#11855) 2024-02-01 19:22:18 +08:00
Wan Kai fc3cc4bd87
sync-ui (#11847) 2024-01-30 16:20:11 +08:00
Wan Kai 9dc4fd3b01
Support available layers of service in the topology. (#11844) 2024-01-30 12:51:15 +08:00
Starry 5b5fb3984f
Add Golang as a supported language for AMQP. (#11838) 2024-01-28 22:52:54 +08:00
peachisai 994ba562f8
Upgrade otel collector version in tests to 0.92 (#11819) 2024-01-27 23:06:45 +08:00
吴晟 Wu Sheng df3b096091
Support Java 21 as runtime and ship jre-21 image. (#11828) 2024-01-24 20:48:39 +08:00
Wan Kai 2f4f4a1275
Add hierarchy relations auto-matching for MYSQL/POSTGRESQL/SO11Y_OAP/VIRTUAL_DATABASE. Fix MQE in dashboards when using `Card widget`. (#11818) 2024-01-24 15:03:45 +08:00
Wan Kai cc79bf688c
Add dashboards for Service/Instance Hierarchy. (#11797)
* Add dashboards for Service/Instance Hierarchy.
Fix dashboard `K8S-Service-Root` metrics expression.
2024-01-18 18:31:19 +08:00
weixiang1862 b43ab447f7
Change topN group key from `StorageId` to `entityId + timeBucket`. (#11788)
In `LimitedSizeBufferedData`, it uses `HashMap<StorageId, LinkedList<STORAGE_DATA>>` to stash records. 
With data storage as topN group key, topN records have no chance to compare with each other, so every record will be stashed into the map and finally persistent into DB. In addition, continuous record stash in a topN period will bring pressure to oap memory.

TopN group key is changed to `entityId + timeBucket`, then stash map can only reserve topN of every entity(db, cache) in the minute level.
2024-01-17 16:00:47 +08:00
peachisai 51c13d6c5b
SWIP-3 Support RocketMQ monitoring (#11783) 2024-01-16 20:23:18 +08:00
peachisai af4f469078
Add `max` and `min` functions for mal down sampling (#11778) 2024-01-16 11:33:09 +08:00
吴晟 Wu Sheng 811b9c1000
Remove unnecessary annotations and functions from Meter Functions. (#11781) 2024-01-16 10:25:27 +08:00
peachisai 52c29354f2
Fix SumPerMinFunctionTest error function (#11773)
Co-authored-by: 邵一鸣 <shaoym02@vanke.com>
2024-01-15 15:56:50 +08:00
mrproliu e481324e93
Support handle eBPF Access Logs and update related UI (#11732) 2024-01-15 11:00:08 +08:00
Fine0830 f0c5b74158
Sync UI (#11765) 2024-01-13 11:19:25 +08:00
Chen Ziyan e004762dfe
Fix NPE in log query by traceId. (#11764) 2024-01-12 20:13:23 +08:00
kezhenxu94 e6f1e3b4c6
Allow using a dedicated port for ALS receiver (#11749) 2024-01-11 15:05:47 +08:00
Wan Kai 593bd056f6
Support Service Hierarchy auto matching. (#11743) 2024-01-10 08:59:04 +08:00
kezhenxu94 b900fd0bb5
Document a new way to load balance OAP (#11737) 2024-01-09 11:21:18 +08:00
mrproliu e50a46b723
Change the string field in Elasticsearch storage from **keyword** type to *text* if they appoint size more than `32766` (#11731) 2024-01-07 18:13:54 +08:00
peachisai 00eb71a1de
Fix incorrect words for pulsar and bookkeeper monitoring docs (#11727) 2024-01-04 19:55:57 +08:00
Wan Kai ce5d6a4ffb
Support build Service/Instance Hierarchy and query. (#11698) 2023-12-27 10:02:31 +08:00
吴晟 Wu Sheng 9ba0ad2991
Update the `Overview` docs to add the `Service Hierarchy Relationship` section. (#11699) 2023-12-26 15:40:43 +08:00
吴晟 Wu Sheng eb4cebf9ab
Set up the length of source and dest IDs in relation entities of service, instance, endpoint, and process to 250(was 200). (#11686) 2023-12-22 09:12:50 +08:00
mrproliu 35e34ce8a2
SWIP-2 Collecting and Gathering Kubernetes Monitoring Data (#11681) 2023-12-21 10:01:57 +08:00
吴晟 Wu Sheng 4c157b4642
SWIP-1 Create and detect Service Hierarchy Relationship (#11670) 2023-12-20 17:29:10 +08:00
吴晟 Wu Sheng 6304cd6223
Begin the process of `SWIP - SkyWalking Improvement Proposal`. (#11668) 2023-12-18 09:37:52 +08:00
Wan Kai e57dee45fb
Add webhook/gRPC hooks settings example for backend-alarm.md. (#11658) 2023-12-15 09:52:12 +08:00
吴晟 Wu Sheng 0e4c0333e0
Polish docs structure. Move customization docs separately from the introduction docs. (#11653) 2023-12-14 10:49:00 +08:00
kezhenxu94 8ff67d09e9
Allow excluding ServiceEntries in some namespaces when looking up ServiceEntries (#11640) 2023-12-08 06:02:17 -08:00
kezhenxu94 39c21e3b45
Remove unreasonable default configurations for gRPC thread executor (#11639) 2023-12-07 21:59:45 -08:00
Jim f6a7791053
Fix "Network Bandwidth Usage" unit/value mismatching in Linux-Service Dashboard (#11637) 2023-12-07 08:55:30 -08:00
吴晟 Wu Sheng 5809200e66
Update docs about release. (#11632) 2023-12-06 15:33:40 -08:00
mrproliu fcf1770e07
Add `is_present` function in MQE for check the present status of the list of metrics. (#11627)
The present status is true meaning the metric exists and include values not empty.
2023-12-05 00:14:42 -08:00
mrproliu e9df2bd41e
Add `layer` parameter to the global topology graphQL query. (#11620) 2023-12-01 10:39:45 -08:00
吴晟 Wu Sheng 497a7bdb02
Release 9.7 and start 10.0 iteration (#11607) 2023-11-28 23:49:44 -08:00
Fine0830 5ab32aa311
sync ui (#11603) 2023-11-27 23:37:56 -08:00
Wan Kai 075b08ce74
Support `increase/rate` function in the `MQE` query language. (#11591) 2023-11-27 15:40:13 -08:00
block666 f964df9f2c
sync ui (#11600) 2023-11-27 08:43:24 -08:00
吴晟 Wu Sheng 58dd3b8922
Remove OpenFunction(FAAS layer) relative UI templates and menu item. (#11570) 2023-11-27 07:30:18 -08:00
kezhenxu94 173c290c19
Group service endpoints into `_abandoned` when endpoints have high ca… (#11588) 2023-11-26 22:15:02 -08:00
Fine0830 04f459174f
Sync ui (#11590) 2023-11-26 18:28:10 +08:00
吴晟 Wu Sheng dd09d08c0c
Support `Scratch The OAP Config Dump`. (#11579) 2023-11-23 00:22:41 +08:00
Fine0830 0fdac95fea
sync ui (#11577) 2023-11-22 13:36:01 +08:00
pg.yang 2d8df37ce6
Fix incorrect apisix metrics otel rules (#11576) 2023-11-22 13:28:59 +08:00
mrproliu df6504863f
Replace Metrics v2 protocol with MQE in UI templates and E2E Test (#11575) 2023-11-22 09:44:37 +08:00
Fine0830 02ebb61710
sync ui (#11573) 2023-11-21 12:47:01 +08:00
mrproliu 7f9a8bb042
Please go2sky E2E to go agent (#11568) 2023-11-20 20:22:25 +08:00
Wan Kai 600ea37a4d
Fix `BanyanDB Metadata Query`: make query single instance/process return full tags to avoid NPE. (#11567) 2023-11-20 14:01:53 +08:00
weixiang1862 8bff0aa38d
Support Nginx monitoring. (#11558) 2023-11-17 14:16:10 +08:00
Fine0830 cb3e830f08
sync ui (#11560) 2023-11-17 10:33:59 +08:00
吴晟 Wu Sheng 257684a0b8
Change the policy of the queue(DataCarrier) L1 in the metric aggregate worker to IF_POSSIBLE mode (#11554) 2023-11-16 19:50:24 +08:00
weixiang1862 eaac1c3ec4
Fix JDBC Log query order. (#11544) 2023-11-15 10:20:20 +08:00
Fine0830 9fee0922a8
Sync UI: Implement the Dark Theme (#11543) 2023-11-14 22:02:54 +08:00
weixiang1862 019c6feb2e
Isolate MAL CounterWindow cache by metric name. (#11526) 2023-11-11 00:09:37 +08:00
吴晟 Wu Sheng 247016fbb5
Support packaging the project in JDK21 (#11528) 2023-11-10 11:23:02 +08:00
kezhenxu94 b514fbcf38
Fix `limit` doesn't work for `findEndpoint` API in ES storage (#11523) 2023-11-09 16:25:54 +08:00
吴晟 Wu Sheng 3c8ac675b5
Update Groovy 3 to 4.0.15. (#11517) 2023-11-09 11:31:31 +08:00
吴晟 Wu Sheng 3cd149a46b
Revert "Add eclipse-temurin:21-jre as a new image runtime (#11464)" (#11516)
This reverts commit 789df669b0.
2023-11-08 23:33:21 +08:00
mrproliu 7b01a4ab91
Fix cannot query zipkin traces with `annotationQuery` parameter in the JDBC related storage (#11511) 2023-11-08 15:06:49 +08:00
吴晟 Wu Sheng f8c6855814
Support output key parameters in the booting logs. (#11506) 2023-11-06 23:57:58 +08:00
peachisai a34a0b71af
Fix incorrect notes of slowCacheReadThreshold. (#11499) 2023-11-04 22:01:11 +08:00
weixiang1862 0f8c67822d
Support extract timestamp from patterned datetime string in LAL. (#11489) 2023-11-03 14:42:04 +08:00
Zhu Wang 19a7fa525d
Fix Kafka e2e format and typos (#11471) 2023-11-01 10:36:55 +08:00
Xiangying Meng ced3f22708
Feature pulsar monitoring (#11339) 2023-10-31 21:04:16 +08:00
yswdqz 92af797296
[Feature] GraalVM Native Image support (Experimental). (#11365) 2023-10-30 21:23:53 +08:00
吴晟 Wu Sheng 789df669b0
Add eclipse-temurin:21-jre as a new image runtime (#11464) 2023-10-27 19:50:13 +08:00
Wan Kai 4c7dbbc57d
BanyanDBStorageClient: Add `define(Property property, PropertyStore.Strategy strategy)` API. (#11461) 2023-10-27 13:39:53 +08:00
吴晟 Wu Sheng 7fa06c028b
Polish docs of `Concepts and Designs` (#11457) 2023-10-26 10:06:33 +08:00
Starry 1706020f30
Add a component ID for Fiber (ID=5021) (#11450) 2023-10-24 08:36:47 +08:00
吴晟 Wu Sheng f38a874355
Sync UI (#11448) 2023-10-23 20:11:38 +08:00
Wan Kai 6d85b931b9
Add missing metrics to the `OpenTelemetry Metrics` doc. (#11446) 2023-10-23 15:21:38 +08:00
peachisai fac8309e13
Add a component ID for Netty (#11442) 2023-10-21 20:39:26 +08:00
Wayne Chu 5d0bd0569b
Support collect ZGC memory pool metrics (#11432)
* Support collect ZGC memory pool metrics

* submodule update
2023-10-20 15:38:33 +08:00
Wan Kai 062b31f4ba
Fix AlarmRule expression validation: add labeled metrics mock data for check. (#11437) 2023-10-20 10:45:15 +08:00
Wan Kai 1a27da5727
Fix `WebhookCallback` send incorrect messages, add catch exception for each callback HTTP Post. (#11424) 2023-10-19 07:24:42 +08:00
dogblues ce707a4d52
Specific only necessary fields when queryBasicTraces in ElasticSearch (#11419) 2023-10-18 01:21:58 -05:00
kezhenxu94 920d6531cf
Bump up netty again to 4.1.100 (#11414)
* Bump up netty again to 4.1.100
2023-10-17 10:54:53 -05:00
Wan Kai 3270d18fe8
Fix `EventHookCallback` build event: build the layer from `Service's Layer` (#11413) 2023-10-16 19:02:50 +08:00
weixiang1862 90f723ef03
Adjust `AlarmRecord` alarmMessage column length to 512. (#11404) 2023-10-12 16:16:42 +08:00
mrproliu 4621e5191f
Enhance extensibility of HTTP Server library (#11401) 2023-10-12 02:12:53 -05:00
Liu Haoyang 34e3b64f94
Fix table exists check in the jdbc storage plugin (#11392) 2023-10-10 17:26:34 +08:00
kezhenxu94 fc151a4843
Bump up netty to 4.1.99 (#11389) 2023-10-08 22:35:10 -05:00
吴晟 Wu Sheng b6392ae8f4
Update Java version to v9 kernel (#11381) 2023-10-08 18:59:44 +08:00
Wan Kai 4fa156aed5
BanyanDBStorageClient: Add `keepAliveProperty` API. (#11383) 2023-10-08 18:08:38 +08:00
吴晟 Wu Sheng 383dd1e9a1
Fix icons display in trace tree diagram. (#11374) 2023-10-05 11:06:23 +08:00
Jiajing LU 338ebcaaa1
Update BanyanDB Java Client to 0.5.0 (#11370) 2023-10-04 09:24:41 -05:00