Commit Graph

612 Commits

Author SHA1 Message Date
Wan Kai ec2ca354ea
Support isEmptyValue flag for metrics query. (#10616) 2023-03-30 14:46:07 +08:00
mrproliu 0de087a100
[Breaking Change] Support cross-thread trace profiling. (#10575)
The data structure and query APIs are changed.
2023-03-22 23:50:26 +08:00
mrproliu c217ead555
Adapt the service level component in E2E (#10530) 2023-03-21 14:45:14 +08:00
mrproliu 7dcdb279ef
Support continuous profiling feature (#10473) 2023-03-20 20:26:42 +08:00
kezhenxu94 74a8589307
[Breaking Change] Enhance JDBC storage through merging table and managing day-based table rolling (#10544)
* [Breaking Change] Enhance JDBC storage through merging tables and managing day-based table rolling.

* [Breaking Change] Sharding-MySQL implementations and tests get removed due to we have the day-based rolling mechanism by default
2023-03-17 21:01:48 +08:00
yswdqz 7447999b4c
Fix wrong layer of metric `userError` in DynamoDB monitoring. (#10518) 2023-03-09 15:09:55 +08:00
yswdqz 6549dc0c0e
Support for double quotes in SlowSQL statements (#10489) 2023-03-06 20:27:07 +08:00
pg.yang cc7a2c9e97
Fix wrong time for OTEL mock service, invalid condition(ge 0) for e2e cases (#10437) 2023-02-23 23:50:25 +08:00
Wan Kai fb9117b8e7
Support prometheus HTTP APIs and promQL. (#10415)
Support HTTP APIs list:

- /api/v1/metadata
- /api/v1/labels
- /api/v1/label/{label_name}/values
- /api/v1/series
- /api/v1/query
-/api/v1/query_range

Support basic promQL for query traffic/metrics/labeled_metrics/topN/sampled_records from OAP
2023-02-22 12:59:45 +08:00
Gao Hongtao 0a35bdd1e2
Update BanyanDB to 0.3.1 release (#10426) 2023-02-22 08:09:27 +08:00
yswdqz f6ef55b5af
Support Monitoring DynamoDB. (#10418) 2023-02-21 09:24:17 +08:00
吴晟 Wu Sheng af3889b47e
Bump up BanyanDB 0.3.0 client. (#10406) 2023-02-20 09:18:41 +08:00
pg.yang cabe40eb47
Support Amazon Simple Storage Service (AWS S3) metrics monitoring (#10407) 2023-02-19 17:23:10 +08:00
Mike 574b83f095
feature: windows monitoring (#10298) 2023-02-15 23:14:04 +08:00
Raigor a87794fb6b
Update ShardingSphere version to 5.3.1 release. (#10259) 2023-01-11 00:24:43 +08:00
Gao Hongtao 6a78773743
Improve BanyanDB measure schema (#10233) 2023-01-08 18:50:00 +08:00
mrproliu 2b40270f71
Add the eBPF network profiling E2E Test in per storage (#10245) 2023-01-06 21:53:39 +08:00
Raigor 2756e0cfab
Update ShardingSphere version for compatibility verification (#10244)
* Integrate with ShardingSphere 5.3.1-SNAPSHOT.

* Update the version of ShardingSphere in e2e

* Remove providerType when the transaction type is LOCAL.

* Update backend-storage.md & changes.md
2023-01-06 17:46:23 +08:00
pg.yang 8de8c7c1e8
Support monitoring AWS Cloud EKS (#10199) 2022-12-31 17:34:30 +08:00
Jiajing LU 222bd4acdb
Refactor Topology query for BanyanDB (#10181) 2022-12-23 16:36:44 +08:00
mrproliu 0b838f9a98
Make the satellite E2E test more stable. (#10176) 2022-12-17 21:04:52 +08:00
kezhenxu94 4ee8389b5c
Add Zipkin UI to webapp (#10167) 2022-12-17 14:30:51 +08:00
吴晟 Wu Sheng 85be0bd568
Remove component_id from the instance topology (#10170) 2022-12-16 21:37:13 +08:00
Jiajing LU bee8a86bda
Optimize BanyanDB interval rules (#10128)
* resolve #10104 #10102
2022-12-13 10:27:41 +08:00
Mahmoud Anwer 3229a5c5ec
Support monitoring mariadb (#10115)
Co-authored-by: yswdqz <945407026@qq.com>
2022-12-11 21:10:23 +08:00
吴晟 Wu Sheng 6ec721e933
Use more aggressive persistent period to stable TTL testing. (#10141) 2022-12-10 22:47:06 +08:00
吴晟 Wu Sheng 4b7ec0bab5
Polish doc (#10114) 2022-12-06 21:59:33 +08:00
Wan Kai ce3196beff
Fix Elasticsearch storage: Query `sortMetrics` missing transform real index column name. (#10036) 2022-11-26 11:15:17 +08:00
Wan Kai ffa4990938
[Feature] Zipkin module support BanyanDB storage. (#10004) 2022-11-22 22:38:38 +08:00
kezhenxu94 87f3fb1890
Use ghcr.io Helm Chart registry in E2E tests (#10005) 2022-11-22 21:44:11 +08:00
yswdqz 6efa15c23f
Modify the format of timebucket in ExtractorSpec (#9988) 2022-11-19 11:33:11 +08:00
kezhenxu94 d48323b958
Adjust OAP log level in E2E to reduce log size (#9972) 2022-11-16 22:42:34 +08:00
Jiajing LU d538868332
Use release version of BanyanDB 0.2.0 and Java Client 0.2.0 (#9946) 2022-11-11 08:46:47 +08:00
yswdqz 109e6dea16
Support MySQL/PostgreSQL cluster mode (#9937) 2022-11-10 22:29:31 +08:00
kezhenxu94 2e3134952e
Refactor jdbc storage implementations to reuse logics (#9904) 2022-11-07 20:02:24 +08:00
soander 42f3396b64
Support the telegraf receiver plugin module (#9620)
* The telegraf receiver plugin module development.

* Refactored code of converting telegraf data and fixed some errors.

* Support Telegraf receiver plugin module.

* Add telegraf-receiver.md, update changes.md and vm-monitoring.md.

* Rename YAML file and change code style.

* Change receiver-telegraf of application.yml.

* The receiver-telegraf e2e test.

* The telegraf receiver e2e test.

* Fix an issue and delete redundant configs.

* Add Unit Test about converting Telegraf metrics.

* Adjust Unit Test about converting Telegraf metrics.

* Add License Header to Unit Test and change binary.xml.

* Change module provider's config initialization mechanism.

* Exclude the telegraf-rules in server-starter pom.xml.

* Fix telegraf e2e test issues.

* Change telegraf e2e test.

* Fix issues

* Fix issues.

* Add Sample convert Unit Test.

* Change vm.yaml, related documents and fix some issues.

* Change backend-vm-monitoring.md.

* Fix SampleConvertTest checkstyle issue.

* Change vm.yaml swap MAL.

* Update menu.yml and binary.xml.

* Update Telegraf Unit test.

* Delete telegraf config package, use meter.analyzer.prometheus package to load config file.

* Reorder telegraf metrics in menu.yml.

* Change e2e, vm, config, linux-service and vm.md.

* Update telegraf.conf file.

* Change url of telegraf.conf file.

* Update e2e.yaml, conf file, menu.yml and delete useless code of provider.

* Update grouping sampleFamily by timestamp and name, and add new UTs.

* Update vm-monitoring.md and .asf.yaml.

Co-authored-by: Superskyyy (ONLINE) <Superskyyy@outlook.com>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2022-11-05 08:08:20 +08:00
Jiajing LU d32a318637
Update BanyanDB storage module to adapt BanyanDB 0.2 (#9839)
* update to banyandb client 0.2

* simplify group check and creation

* support indexOnly

* partial apply configuration

* support CompleteableFuture

* fix BanyanDBProfileThreadSnapshotQueryDAO

* optimize BanyanDBProfileTaskQueryDAO

* optimize *LogQueryDAO

* support indexType

* add configuration

* use TTL from core config

Signed-off-by: Megrez Lu <lujiajing1126@gmail.com>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2022-11-04 11:33:21 +08:00
pg.yang 828e6e2f2b
Add virtual MQ analysis for native traces (#9855) 2022-11-02 08:05:35 +08:00
yswdqz e497efd245
Change the way of loading MAL rules (#9822) 2022-11-01 15:11:04 +08:00
kezhenxu94 fb2ac0e7f9
Split TCP related service mesh metrics protobuffer definition (#9851) 2022-10-28 09:14:38 +08:00
mrproliu 2e6e3faef0
Support new records query protocol (#9827) 2022-10-22 11:30:52 +08:00
Wan Kai d98775790a
Support export `Trace` and `Log` through Kafka. (#9817) 2022-10-21 08:04:18 +08:00
pg.yang 4aa516ad58
Polish up APISIX metrics to follow Service concept (#9775) 2022-10-13 15:49:57 +08:00
kezhenxu94 091b7810c1
Unify the service label in postgresql MAL (#9752) 2022-10-10 23:22:29 +08:00
pg.yang 8aa046b8d7
Add APISIX metrics monitoring (#9725) 2022-10-05 18:23:37 +08:00
kezhenxu94 dd6b7a1fc0
Remove Prometheuse fetcher, fix MAL Histogram type bug, and reorganize the doc (#9710)
* [**Breaking Change**]: Remove prometheus-fetcher plugin, please use OpenTelemetry to scrape Prometheus metrics and
   set up SkyWalking OpenTelemetry receiver instead.
 * BugFix: histogram metrics sent to MAL should be treated as OpenTelemetry style, not Prometheus style:
   ```
   (-infinity, explicit_bounds[i]] for i == 0
   (explicit_bounds[i-1], explicit_bounds[i]] for 0 < i < size(explicit_bounds)
   (explicit_bounds[i-1], +infinity) for i == size(explicit_bounds)
   ```
2022-09-30 13:13:03 +08:00
Wan Kai d7ee9a01d6
Support sharding MySQL database instances and tables. (#9689)
* [**Breaking Change**] Support sharding MySQL database instances and tables by [Shardingsphere-Proxy](https://shardingsphere.apache.org/document/current/en/overview/#shardingsphere-proxy).
  SQL-Database requires removing tables `log_tag/segment_tag/zipkin_query` before OAP starts, if bump up from previous releases.
2022-09-30 08:39:14 +08:00
kezhenxu94 bf4cf9d8a0
Clean up some legacy codes (#9682) 2022-09-25 23:33:42 +08:00
yswdqz f9db9ba2dc
Support monitoring PostgreSQL slow SQLs. (#9673) 2022-09-23 20:31:17 +08:00
pg.yang bbe0a7c4c2
Support analyzing cache related spans to provide metrics and slow commands for cache services from client side. (#9622)
* Support analyzing cache related spans to provide metrics and slow commands for cache services from client side
* Optimize virtual database, fix dynamic config watcher NPE when default value is null 
* [UI] Add virtual cache dashboard
2022-09-19 22:10:32 +08:00