Commit Graph

139 Commits

Author SHA1 Message Date
kezhenxu94 7a28b19842
Rename Helm registry name (#11382) 2023-10-08 08:27:54 -05:00
吴晟 Wu Sheng 10580355be
Disable Istio metric service (#11384) 2023-10-08 17:24:52 +08:00
吴晟 Wu Sheng bdfe6168cc
Disable Istio relative e2e (#11371) 2023-10-04 08:04:09 +08:00
Zhu Wang 1c273d6f80
[Feature] Add kafka monitoring (#11282) 2023-09-13 21:12:34 +08:00
mrproliu 31e0ecacdb
Add OTLP Tracing support as a Zipkin trace input (#11287) 2023-09-01 17:12:58 +08:00
kezhenxu94 49bf7a171a
Make builds reproducible for automatic releases CI (#11204) 2023-08-11 10:38:12 +08:00
吴晟 Wu Sheng a1ed1fb447
Bump up version of ASF parent pom to v30. (#11209) 2023-08-11 09:29:30 +08:00
kezhenxu94 81db831eb0
Revert "Change base image from `eclipse-temurin:x-jre` to `eclipse-temurin:x-jre-alpine` to reduce CVE exposure surface (#11181)" (#11182)
This reverts commit 2719c7db18.
2023-08-07 10:29:21 +08:00
kezhenxu94 2719c7db18
Change base image from `eclipse-temurin:x-jre` to `eclipse-temurin:x-jre-alpine` to reduce CVE exposure surface (#11181) 2023-08-07 09:16:20 +08:00
吴晟 Wu Sheng abc7aa88f1
Polish ElasticSearch relative docs and bump up tested versions. (#11179) 2023-08-05 22:56:22 +08:00
weixiang1862 0949db406d
Support LogQL HTTP query APIs. (#11168) 2023-08-03 22:05:31 +08:00
weixiang1862 8a82ac885d
Support MongoDB monitoring (#11111)
Co-authored-by: weixiang1862 <weixiang1862@gmail.com>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
Co-authored-by: Harry <innerpeace.zhai@gmail.com>
2023-07-20 20:18:56 -07:00
mrproliu 6131e4c6a3
Support dynamic UI menu query (#11005) 2023-06-29 14:09:32 +08:00
kezhenxu94 e2f0bee06b
Clean up tests for components that are too old (#10981) 2023-06-23 22:42:23 +08:00
Wan Kai 4d191993aa
Fix `NPE` in metrics query when the metric is not exist. (#10980)
* Fix `NPE` in metrics query when the metric is not exist.

* Fix metric name `browser_app_error_rate` in `Browser-Root` dashboard.

* Exclude istio 1.7 from testing again.

---------

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2023-06-23 14:41:31 +08:00
kezhenxu94 cf696ab698
Only list healthy Pods when forming OAP cluster (#10969) 2023-06-21 14:02:26 +08:00
吴晟 Wu Sheng 56cfa52d87
Remove `matchedCounter` from `HttpUriRecognitionService#feedRawData` (#10966)
* [Breaking change] Remove `matchedCounter` from `HttpUriRecognitionService#feedRawData`.

* * Remove patterns from `HttpUriRecognitionService#feedRawData` and add max 10 candidates of raw URIs for each pattern.

---------

Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2023-06-20 13:17:05 -04:00
kezhenxu94 cb2676845b
Improve Kubernetes coordinator to only select ready OAP Pods to build cluster (#10950) 2023-06-16 21:45:19 +08:00
Wan Kai feb3ca2b6d
Add UT and E2E for MQE. (#10920) 2023-06-13 17:58:15 +08:00
kezhenxu94 e4dfbd466b
Add OpenSearch 2.8.0 to test case (#10886) 2023-06-07 11:09:26 +08:00
Superskyyy d21f040620
Migrate to new changes filter action in CI (#10812) 2023-05-23 09:41:15 +08:00
yswdqz 81ec3af923
[Feature] Redis slow log collection (#10825) 2023-05-22 20:31:00 +04:00
innerpeacez 1230bf4d4b
Support RabbitMQ monitoring (#10814) 2023-05-17 11:56:44 +08:00
innerpeacez cce87a9917
Support Elasticsearch monitoring (#10690) 2023-04-20 17:53:01 +08:00
yswdqz 2cbeb55359
Support Redis Mornitoring (#10655) 2023-04-08 19:03:31 +08:00
pg.yang b7f456d29f
Support Amazon API Gateway monitoring (#10645) 2023-04-05 12:19:46 +08:00
Wan Kai 6d432c31f2
PromQL: Remove empty values from the query result, fix `/api/v1/metadata` param `limit` could cause out of bound. (#10628) 2023-03-31 16:35:06 +08:00
Fine0830 7168f6d7e9
Sync UI (#10614) 2023-03-30 11:09:52 +08:00
kezhenxu94 6fa89c7991
Fix T+1 table is delete when deleting history tables, in jdbc storage (#10600) 2023-03-28 16:23:02 +08:00
mrproliu 7dcdb279ef
Support continuous profiling feature (#10473) 2023-03-20 20:26:42 +08:00
kezhenxu94 719434f8c1
Cache test services dependencies (#10554) 2023-03-17 21:55:24 +08:00
kezhenxu94 74a8589307
[Breaking Change] Enhance JDBC storage through merging table and managing day-based table rolling (#10544)
* [Breaking Change] Enhance JDBC storage through merging tables and managing day-based table rolling.

* [Breaking Change] Sharding-MySQL implementations and tests get removed due to we have the day-based rolling mechanism by default
2023-03-17 21:01:48 +08:00
kezhenxu94 2e04b069bf
JavaDoc input should contain delombok output and fix javadoc not executed in CI (#10534) 2023-03-14 07:35:37 +08:00
kezhenxu94 5099cc72ba
Fix javadoc error and run javadoc in CI (#10515) 2023-03-09 11:41:15 +08:00
kezhenxu94 62926da42a
Bump up license-eye to speed up CI (#10443) 2023-02-24 14:11:47 +08:00
吴晟 Wu Sheng d5928245d0
Add explicit `ReadTimeout` for ConsulConfigurationWatcher (#10431)
* Add explicit `ReadTimeout` for ConsulConfigurationWatcher

* Bump up skywalking-eyes
2023-02-23 10:40:11 +08:00
yswdqz f6ef55b5af
Support Monitoring DynamoDB. (#10418) 2023-02-21 09:24:17 +08:00
pg.yang cabe40eb47
Support Amazon Simple Storage Service (AWS S3) metrics monitoring (#10407) 2023-02-19 17:23:10 +08:00
kezhenxu94 e357b2335a
Add Istio 1.17 to test matrix (#10395) 2023-02-16 09:06:04 +08:00
Mike 574b83f095
feature: windows monitoring (#10298) 2023-02-15 23:14:04 +08:00
kezhenxu94 49594c4db1
Bump up Java version to 11 and use junit tag to group IT and slow IT (#10390)
- `./mvnw test ...` by its nature only runs unit tests, whose name is pattern of `*Test`, and it does never runs integration tests, whose name is patter of `IT*` or `*IT`, so in this PR we use `./mvnw clean test ...` to only run unit tests.
- `./mvnw integration-test ...` will run integration tests and unit tests, so we have `skipUTs` to control whether to skip the UT when running ITs, we already had this before.
  - As for ITs, we have two groups, one is normal tests without any `@Tag`s, the other one is slow integration tests, which is annotated with `@Tag("slow")`, so we divided the integration tests into two workflow jobs:
  - `./mvnw -DskipUTs=true clean integration-test -DexcludedGroups=slow ...` run the ITs but don't run the slow ITs and UTs, `-DexcludedGroups=slow` excludes tests annotated with `@Tag("slow")`
  - `./mvnw -DskipUTs=true clean integration-test -Dcheckstyle.skip -Dtest=${{ matrix.test.class }}` run the slow ITs (because `excludedGroups` is not set) one case at a time, by setting `-Dtest={{ class }}`, not run UTs,
2023-02-14 23:19:32 +08:00
kezhenxu94 383a5bbf7b
Migrate tests from junit 4 to junit 5 (#10382) 2023-02-13 18:54:32 +08:00
mrproliu 2b40270f71
Add the eBPF network profiling E2E Test in per storage (#10245) 2023-01-06 21:53:39 +08:00
pg.yang 8de8c7c1e8
Support monitoring AWS Cloud EKS (#10199) 2022-12-31 17:34:30 +08:00
kezhenxu94 9c0ef79156
Add istio 1.16 to test matrix (#10177) 2022-12-17 23:55:59 +08:00
Superskyyy 3fd5b058ed
Fix uncancellable ci jobs due to always() condition (#10148) 2022-12-12 14:53:19 +08:00
Mahmoud Anwer 3229a5c5ec
Support monitoring mariadb (#10115)
Co-authored-by: yswdqz <945407026@qq.com>
2022-12-11 21:10:23 +08:00
mrproliu f2fd64bdf8
Adjust the span match rule of the attached event (#10069) 2022-12-01 21:22:17 +08:00
kezhenxu94 a7210f6633
Add OpenSearch 1.3.6 and 2.4.0 to test matrix (#10040) 2022-11-29 11:13:01 +08:00
Wan Kai ffa4990938
[Feature] Zipkin module support BanyanDB storage. (#10004) 2022-11-22 22:38:38 +08:00
Wan Kai 0a2ee589d5
Test: Add integration test for Shardingsphere-proxy (#9969)
* Fix `ShardingTopologyQueryDAO.loadServiceRelationsDetectedAtServerSide` miss serviceIds.
* Add sharding integration test.
2022-11-17 20:42:09 +08:00
Hoshea Jiang 07bfde6e25
Bump infra e2e action's version to reduce outputs in CI (#9959) 2022-11-16 11:53:29 +08:00
soander 42f3396b64
Support the telegraf receiver plugin module (#9620)
* The telegraf receiver plugin module development.

* Refactored code of converting telegraf data and fixed some errors.

* Support Telegraf receiver plugin module.

* Add telegraf-receiver.md, update changes.md and vm-monitoring.md.

* Rename YAML file and change code style.

* Change receiver-telegraf of application.yml.

* The receiver-telegraf e2e test.

* The telegraf receiver e2e test.

* Fix an issue and delete redundant configs.

* Add Unit Test about converting Telegraf metrics.

* Adjust Unit Test about converting Telegraf metrics.

* Add License Header to Unit Test and change binary.xml.

* Change module provider's config initialization mechanism.

* Exclude the telegraf-rules in server-starter pom.xml.

* Fix telegraf e2e test issues.

* Change telegraf e2e test.

* Fix issues

* Fix issues.

* Add Sample convert Unit Test.

* Change vm.yaml, related documents and fix some issues.

* Change backend-vm-monitoring.md.

* Fix SampleConvertTest checkstyle issue.

* Change vm.yaml swap MAL.

* Update menu.yml and binary.xml.

* Update Telegraf Unit test.

* Delete telegraf config package, use meter.analyzer.prometheus package to load config file.

* Reorder telegraf metrics in menu.yml.

* Change e2e, vm, config, linux-service and vm.md.

* Update telegraf.conf file.

* Change url of telegraf.conf file.

* Update e2e.yaml, conf file, menu.yml and delete useless code of provider.

* Update grouping sampleFamily by timestamp and name, and add new UTs.

* Update vm-monitoring.md and .asf.yaml.

Co-authored-by: Superskyyy (ONLINE) <Superskyyy@outlook.com>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2022-11-05 08:08:20 +08:00
Superskyyy fa110f744a
Override cache restore timeout (#9894) 2022-11-02 14:15:36 +08:00
pg.yang 828e6e2f2b
Add virtual MQ analysis for native traces (#9855) 2022-11-02 08:05:35 +08:00
kezhenxu94 e4c88c2330
Speed up CI by caching the build of e2e (#9868) 2022-11-01 10:33:03 +08:00
Wan Kai d98775790a
Support export `Trace` and `Log` through Kafka. (#9817) 2022-10-21 08:04:18 +08:00
pg.yang 8aa046b8d7
Add APISIX metrics monitoring (#9725) 2022-10-05 18:23:37 +08:00
Wan Kai d7ee9a01d6
Support sharding MySQL database instances and tables. (#9689)
* [**Breaking Change**] Support sharding MySQL database instances and tables by [Shardingsphere-Proxy](https://shardingsphere.apache.org/document/current/en/overview/#shardingsphere-proxy).
  SQL-Database requires removing tables `log_tag/segment_tag/zipkin_query` before OAP starts, if bump up from previous releases.
2022-09-30 08:39:14 +08:00
yswdqz d3727b7a9f
Enhance LAL to support convert LogData to DatabaseSlowStatement. (#9575) 2022-09-16 12:42:43 +08:00
kezhenxu94 f378b37139
Add ElasticSearch 8.1.0, OpenSearch 2.3.0 and istio 14/15 to test matrix (#9608) 2022-09-16 08:27:40 +08:00
kezhenxu94 b3c7658a0e
webapp: migrate from Spring Web to Armeria (#9592) 2022-09-11 16:33:53 +08:00
kezhenxu94 526aa3a5fd
Fix UI dependencies versions changed in license eye (#9568) 2022-09-07 12:49:52 +08:00
kezhenxu94 74cd559c47
Bump up infra e2e version and fix istio cases (#9529) 2022-08-27 11:45:34 +08:00
Wan Kai 7df469a6e8
Fix JDBC TTL to delete additional tables data. (#9508) 2022-08-24 18:41:21 +08:00
yswdqz 828669ce2a
Support PostgreSQL monitoring. (#9495) 2022-08-22 14:29:26 +08:00
kezhenxu94 1377865f3e
Adopt license eye to check dependencies' license (#9220) 2022-08-21 18:31:38 +08:00
yswdqz aa6c5e9182
Support MySQL monitoring. (#9432) 2022-08-12 16:51:36 +08:00
mrproliu 0c2bf2c9ff
Support analyze the component in the eBPF Network profiling (#9430) 2022-08-06 23:32:14 +08:00
mrproliu 4bd4231b60
Elasticsearch storage support merge all records(without super datasets) indices into one physical index (#9424) 2022-08-05 10:40:33 +08:00
Wan Kai 0a032ced18
Elasticsearch storage support merge all metrics/meter indices into one physical index (#9416) 2022-08-03 21:18:30 +08:00
mrproliu b8cf95d165
Add `SUM_PER_MIN`(sumHistogramPercentile) downsampling in MAL. Add eBPF Network Profiling E2E (#9377) 2022-07-28 10:00:36 +08:00
Wan Kai e346b618ea
Support Zipkin kafka collector. (#9252) 2022-06-21 20:40:43 +08:00
Wan Kai 43d65775f0
Add more entities for Zipkin to improve performance (#9198) 2022-06-10 20:04:11 +08:00
Wan Kai f0aef53d49
Support Zipkin traces collect and zipkin traces query API. (#9177) 2022-06-08 07:40:36 +08:00
mrproliu b695983fc5
Add OFF CPU eBPF Profiling E2E Testing and Sync UI (#9122) 2022-05-23 23:09:37 +08:00
Jiajing LU 133b2e4ad9
Add event E2E for BanyanDB (#9119) 2022-05-23 09:31:29 +08:00
mrproliu e8b24e7fb2
Add TiDB, OpenSearch, Postgres storage optional to Trace and eBPF Profiling E2E testing. (#9117) 2022-05-22 14:54:26 +08:00
Jiajing LU 25ebd6c242
Add Banyandb storage e2e (#9112) 2022-05-21 19:48:56 +08:00
kezhenxu94 5ab92ebea2
Skip CI for all licenses files (#9096) 2022-05-19 08:20:07 +08:00
吴晟 Wu Sheng fcc6a16215
Remove InfluxDB 1.x and Apache IoTDB 0.X as storage options (#9060)
* Remove InfluxDB 1.x and Apache IoTDB as storage options.

* Update dependencies.
2022-05-13 21:30:24 +08:00
kezhenxu94 369949b29a
Clean up scroll context after going through the results (#8967) 2022-05-06 09:35:27 +08:00
Superskyyy 00363a02a8
Enhance CI skipping strategy (#8982) 2022-05-04 00:48:29 -04:00
mrproliu a93667184f
Support receive Kubernetes process from the Rover (#8960) 2022-04-27 19:20:50 +08:00
kezhenxu94 e38f25e28b
[CI] set up Java explicitly and use the built-in cache mechanism (#8851) 2022-04-11 18:55:39 +08:00
kezhenxu94 2db93e1981
Fix wrong ignore paths in GHA workflows (#8805) 2022-04-05 18:43:47 +08:00
mrproliu 2a8bf4deff
Support eBPF Profiling E2E (#8761) 2022-03-30 12:11:30 +08:00
kezhenxu94 eccca8506f
Remove fake required workflows (#8692) 2022-03-17 11:29:37 +08:00
kezhenxu94 bf03d9f67a
Improve CI with the GHA new feature (#8691) 2022-03-17 10:06:53 +08:00