Commit Graph

206 Commits

Author SHA1 Message Date
吴晟 Wu Sheng 64ff0305f7
test: add JDK 15 into test matrix (#6082) 2021-04-12 15:17:20 +08:00
Zhenxu Ke 25214e910a
Collect and report agent starting / shutdown events (#6559) 2021-03-18 15:25:06 +08:00
Zhenxu Ke 0fdb165662
Set up code quality check and fix some (#6519) 2021-03-09 18:15:00 +08:00
Zhenxu Ke 207cef7930
Add Istio 1.9.1 into test matrix (#6476) 2021-03-03 08:29:57 +08:00
John Bampton 85fc4f827c
Fix spelling (#6418) 2021-02-22 07:40:35 +08:00
zhang-wei 1c52995cbf
Supplement the E2E test for skywalking-client-js (#6409) 2021-02-21 22:29:50 +08:00
Zhenxu Ke 9de93119e2
Enhance gRPC log appender to allow layout pattern (#6403) 2021-02-21 12:53:44 +08:00
haoyann c45bb361ee
Storage plugin supports PostgreSQL (#6345) 2021-02-20 20:59:51 +08:00
Zhenxu Ke 1e4a8ee19b
Fix dead links and add checker to detect them (#6394) 2021-02-18 12:31:22 +08:00
mrproliu 75f03acba7
Adopt Zabbix protocol (#6176)
Happy Chinese New Year !!
2021-02-10 22:40:07 +08:00
Zhenxu Ke 30a88b555f
Skip CI in some cases to save resources (#6340) 2021-02-07 16:19:55 +08:00
Zhenxu Ke b92eac2cd6
Add a new concept "Event" and its implementations to collect events (#6183) 2021-02-05 18:37:18 +08:00
Zhenxu Ke 56c264d1fa
test: fix flaky E2E test of Kafka (#6281) 2021-01-30 11:46:05 +08:00
Zhenxu Ke 5d47d4d29f
Remove state / isError and collect exception stacktrace in error logs (#6275) 2021-01-30 08:18:52 +08:00
zhang-wei 01d1eff6c7
Enhancement log-recerive e2e test (#6248) 2021-01-29 00:07:16 +08:00
吴晟 Wu Sheng 7b1c63de11
Remove optional log plugin (#6259) 2021-01-26 23:23:14 +08:00
Daming 9021e67912
fix kafka e2e testing (#6217) 2021-01-16 20:41:46 +08:00
Zhenxu Ke cbfe7ee87c
Set up test for Istio 1.8.2 to verify Envoy V3 protocol (#6215) 2021-01-16 12:44:26 +08:00
Zhenxu Ke 98d0430b91
chore: set up license-eye to check license header (#6200) 2021-01-14 22:08:37 +08:00
zhang-wei 15452025c6
Log collecting and query implementation (#6120) 2021-01-14 09:49:11 +08:00
Zhenxu Ke 34684cefcf
Fix scheduled tasks timezone in GHA (#6161) 2021-01-09 10:36:16 +08:00
Zhenxu Ke afc44d4a3d
Unify the service name rule in `metadata-service-mapping.yml` of `mx-… (#6131) 2021-01-08 13:54:04 +08:00
Zhenxu Ke f3d5153a80
Add ElasticSearch 7.10 to test matrix (#6137) 2021-01-07 10:11:13 +08:00
Zhenxu Ke f54f639c4d
Enhance Envoy metrics service analyzer by MAL (#6091) 2021-01-02 14:34:54 +08:00
vcjmhg c010481cf6
Checkstyle plugin checks test codes (#6003) 2020-12-29 17:58:34 +08:00
Zhenxu Ke 462c685836
Update cancel.yaml to use ASF GHA (#6087) 2020-12-27 23:16:41 +08:00
Zhenxu Ke d4175d84b1
test: add e2e for NodeJS agent (#6073) 2020-12-24 16:07:07 +08:00
Zhenxu Ke 6feeaf6e5f
Update submodule to sync namespaced proto files (#6026)
* update submodule to sync namespaced proto files

* add compat E2E test and update mock collector

* add changelog, fix GHA syntax, compat Java agent

* highlight notes, use archive dist, revert compat in agent

* polish changelog, add missing `-javaagent` in provider

* fix wrong position of JAVA_OPTS

* polish changelog
2020-12-18 12:29:44 +08:00
vcjmhg 0996151973
Support collecting logs of log4j, log4j2, and logback in the tracing context (#5914) 2020-12-10 13:53:30 +08:00
mrproliu 4aa9f301d0
Add alarm tests in the e2e (#5961) 2020-12-08 16:47:28 +08:00
Zhenxu Ke b5367aa6b1
test: extract so11y test and add logs (#5955)
* Increase metrics time range
* Remove unused codes
* Update SO11yE2E.java

Co-authored-by: Hongtao Gao <hanahmily@gmail.com>
2020-12-06 22:15:37 +08:00
zifeihan 6e0a244482
Add the plugin for Apache CXF 3.x (#5887) 2020-11-26 17:18:55 +08:00
Lu Jiajing d9623ec487
Spring-Kafka 1.x support (#5879)
* support spring-kafka 1.3.x and add test

* add spring-kafka-1.3.x-scenario to github workflow

* change kafka-plugin FAQ

* add supported versions

* update CHANGES.md
2020-11-24 19:32:37 +08:00
Jared Tan 8d164d3dd8
Add Tidb provider module. (#5844)
* fix transaction too large error when use TiDB as storage

* add CHANGES.md

* fix typo

* add tidb storage provider module.

* add e2e.

* revert ui submodule.

* fix license.

* Fix wrong health check test

* add tidb ttl e2e.

Co-authored-by: moonsphere <moonsphere@m.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
2020-11-22 23:28:54 +08:00
zifeihan d6c9926e9e
Add the plugin for microsoft mssql-jdbc (#5856) 2020-11-18 15:48:18 +08:00
zifeihan 7220643cbf
Add the plugin for mssql-jtds 1.x plugin. (#5842)
* Add the plugin for mssql-jtds 1.x plugin.
2020-11-16 08:30:25 +08:00
kezhenxu94 8da9bf94ab
ALS analyzer based on Envoy metadata exchange (#5800) 2020-11-09 00:01:12 +08:00
King bc7afa6347
add support for dbcp 2.x plugin (#5550) 2020-11-08 09:41:56 +08:00
Kcat c32caab6e0
Add async-http-client plugin (#5690) 2020-11-06 00:33:47 +08:00
Jarek Potiuk b041ecb2a9
The Cancel step is now optimised in one job (#5782)
The cancel steps were tried in separate jobs but it causes
an unnecessary increase in the number of jobs blocking the queue
even if we limited parallelism. This PR combines all the cancel
actions into a single job with multiple steps.

While this is a bit more copy&pasting and less DRY it is also
far more optimised and "aggressive" - i.e. once any cancel
job starts to be running it will immediately cancel all duplicates
for all workflows.
2020-11-03 19:31:36 +08:00
kezhenxu94 66dd848e84
test: E2E Elasticsearch 7.x highest and lowest versions (#5779) 2020-11-03 16:42:13 +08:00
Jarek Potiuk 63c016d3f6
Simplifies canceling workflow (#5776)
Instead of multiple workflow-runs generated for different workflows
this change replces it with single workflow, cancelling all others.
It is triggered by only one CI-IT workflow, because this one is
always triggered when all others are. It also sets parallelism
of the matrix to 4, so that there are not too many jobs in
parallel taken when this workflow runs.
2020-11-03 14:31:24 +08:00
吴晟 Wu Sheng 19752ad098
Upgrade the cancel plugin (#5766) 2020-11-02 10:40:25 +08:00
kezhenxu94 a5300880d7
[CI] Cancel outdated jobs when new builds are fired (#5558) 2020-11-02 00:19:57 +08:00
Evan 603187b7a8
Apply tags from Correlation Context key/values to Spans (#5685)
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
2020-11-01 20:51:21 +08:00
kezhenxu94 92bb474c2d
Improve Kubernetes service registry for ALS analysis (#5722)
The current implementation of envoy ALS K8S analysis is based on the hierarchy, pod -> StatefulSet -> deployment, StatefulSet, or others. It's freaky and different from the Istio Kubernetes registry.

The new path is pod -> endpoint -> service, and we should leverage Informer API instead of raw Kubernetes API.
2020-10-29 18:22:38 +08:00
Daming 0c4827d056
remove finagle-6.25.0-scenario (#5747) 2020-10-29 07:50:57 +08:00
Daming 98968122e9
Provide Thrift Plugin (#5644) 2020-10-16 16:09:47 +08:00
kezhenxu94 d113f58645
test: add a tool to select a suitable group for a new plugin test and remove the outdated group size of plugin tests (#5676) 2020-10-16 08:44:55 +08:00
kezhenxu94 239eaa01fd
test: set up ALS E2E test (#5675) 2020-10-15 23:20:46 +08:00
吴晟 Wu Sheng 235fbe729c
Fix 3 format issue of CI control file. (#5625)
* Fix 3 format issue of CI control file.

* Fix more.
2020-10-02 18:17:55 +08:00
吴晟 Wu Sheng 2b737e24e4
Embrace the maven cache in the GitHub action. (#5619)
* Add cache for maven local repo.

* FIx formats.
2020-10-01 19:05:28 +08:00
吴晟 Wu Sheng 103cf00672
Support JDK 11 compiling and upgrade dependencies (#5579)
* Upgrade dependencies and make the JDK11 compiling passed.

* Update license and fix license check file.

* Add CI for JDK11 compiling.

* Update doc.
2020-09-29 10:34:21 +08:00
Xin,Zhang f3967840c5
Fix the failure of Oracle scenario (#5540) 2020-09-23 07:47:55 +08:00
harvies c33a55cda1
Test for mongo3.x support version (#5539) 2020-09-22 22:08:58 +08:00
harvies 1ff25ac4f4
Support mongo driver 4.x version. (#5512) 2020-09-22 17:09:24 +08:00
hailin0 e200ef1045
Add support for xxl-job (#5519) 2020-09-20 10:04:32 +08:00
Evan 29de696c42
exception-ignore-plugin (#5426) 2020-09-09 15:07:01 +08:00
zhang-wei 7ef8b3e476
Support Browser protocol at OAP (#4228) 2020-08-31 15:46:37 +08:00
hailin0 ca957699dc
Add support for quartz-scheduler (#5413) 2020-08-30 23:48:26 +08:00
hailin0 afc0aef567
Add logic-endpoint and testcase for elasticjob-2.x plugin (#5395) 2020-08-28 14:27:07 +08:00
Xin,Zhang 77d94b4d2a
Fix issue that spring mvc plugin doesn't works when running on reactive api (#5360) 2020-08-26 13:22:39 +08:00
Daming 6c1659c56a
[plugin/test] Plugin test with jdk14 (#5352)
* plugin test with jdk14

* introduce jdk14 container

* remove docker:build

* remove BUILD_NO and introduct image_version

* Update docs/en/guides/Plugin-test.md

Co-authored-by: kezhenxu94 <kezhenxu94@163.com>

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
2020-08-24 20:17:22 +08:00
hailin0 1b54b61a88
Add support for spring @Scheduled (#5339) 2020-08-23 17:13:49 +08:00
Evan 68317dd910
Add agent plugins selector (#5293) 2020-08-14 15:06:30 +08:00
于玉桔 e37fc2e439
Support spring-kafka (#5254) 2020-08-10 19:13:19 +08:00
于玉桔 69297b9ec6
Support Apache ShardingSphere-Elasticjob (#5153) 2020-08-10 10:48:23 +08:00
于玉桔 7a20c260bb
Add HBase hbase-client plugin (#5225) 2020-08-05 17:55:20 +08:00
Daming f9257f5274
Provide kafka as collector/reporter (#4847) 2020-07-30 11:55:49 +08:00
mrproliu 925c0d74c7
Provide server-side meter (#4972) 2020-07-25 21:17:32 +08:00
caoyixiong 80a534b1bb
support Graphql Logic endpoint (#5030) 2020-07-05 23:37:09 +08:00
gongdewei 1817386391
Support cache mode in the agent. (#4858) 2020-07-01 23:20:50 +08:00
caoyixiong 31f42343f6
add brpc-java plugin (#4958) 2020-06-27 14:57:29 +08:00
dagmom 08897ce5f8
New feature provided : new plugin for influxdb-java client (#4846) 2020-06-21 22:35:45 +08:00
于玉桔 c778a0d6c2
Support Quasar fiber tracing (#4951) 2020-06-20 22:30:03 +08:00
xiaoyu 164124fc22
provider shardingSphere 4.0.0 4.0.1 plugin. (#4927) 2020-06-15 17:03:17 +08:00
xiaoyu a24efcf5e9
ShardingSphere plugins conflict among themselves. (#4921)
* Fix shardingSphere plugin test fail if have some same ENHANCE_CLASS define.

* support 4.1.0 and 4.1.1

* support 4.1.0 and 4.1.1
2020-06-14 18:48:07 +08:00
吴晟 Wu Sheng 5de0d2c6f6
Set version to 8.1.0 for next iteration. (#4916)
* [maven-release-plugin] prepare release v8.0.0

* [maven-release-plugin] prepare for next development iteration

* Remove all shardingsphere cases.
2020-06-12 23:44:42 +08:00
Xin,Zhang 7b99019c49
Refactory spring gateway plugin (#4878) 2020-06-12 00:25:41 +08:00
何延龙 305a6b3032
[PHP-E2E] Support v8 (#4862) 2020-06-05 18:02:44 +08:00
Brandon Fergerson 705f97f27a
Increased Vert.x support (#4840) 2020-06-01 21:00:16 +08:00
Brandon Fergerson 594fb15b53
Increased support for Vertx (#4827) 2020-05-26 22:02:34 +08:00
kezhenxu94 576bd7e286
Test: add E2E test for Python Agent (#4770) 2020-05-11 16:05:06 +08:00
Efe Kaptan d19ba41678
Mariadb JDBC plugin (#4740)
* Add Mariadb JDBC plugin and provide tests

* Refactor component name

* Reformat plugin description and remove healthcheck span from the test

Co-authored-by: Efe Kaptan <Efe.Kaptan@webtrekk.com>
Co-authored-by: zhang-wei <pknfe@outlook.com>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-05-07 20:54:30 +08:00
Brandon Fergerson 4fc57a6663
Increase Vert.x Compatability (#4736)
* vertx web plugin re-impl attempt

* added license

* update test for new plugin structure

* got rid of registryItems

* remove unnecessary dependencies

* re-impl eventbus scenario

* more precise naming

* fix expected data

* removed unsupported versions and removed vertx caching (avoids permission error)

* rewrote to remove copied code

* Update plugins-test.3.yaml

* fixes issue of .vertx files remaining on v3.0.0

* only present in v3.0.0

* consistency

* add more supported versions

* track status code

* spelling fix

* track status code

* more correct naming

* reverts 213f5a69 (status code isn't sent at this point)

* made HttpServerResponseImplEndInstrumentation more strict based on version
added status code tracking
fixes issue not finishing async spans

* works 3.0.0,3.7.0

* increase compatibility

* 3.9.0 default

* versioned witness classes (advice from wu-sheng)

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: zhang-wei <pknfe@outlook.com>
2020-05-01 17:06:46 +08:00
kezhenxu94 4a8f86f817
Use the built-in ability to check out submodules (#4728) 2020-04-28 20:32:56 +08:00
Brandon Fergerson 776d508018
Vertx plugin test re-implementation (#4624)
* vertx web plugin re-impl attempt
2020-04-24 19:49:03 +08:00
Daming 44f1b4a4ff
[test/plugin] Enhance PluginTest (#4677)
1. Re-balance the workload of plugintests
2. Restore testcases of MySQL, remove on #4641
3. Support user to runs plugin-test on debug mode. It will not remove the log files and actualData.yaml
4. remove paramater 'parallel_run_size' and disable parallel test.
2020-04-22 20:43:17 +08:00
kezhenxu94 8e6a527f78
Add Java versions 9~14 to E2E tests (#4674) 2020-04-21 13:45:32 +08:00
Daming 28530cd79d
Upgrade the InfluxDB storage-plugin to protocol V3 (#4641)
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2020-04-19 20:10:59 +08:00
kezhenxu94 c11ad038cc
Count the coverage in E2E tests and Plugin tests (#4651) 2020-04-15 23:09:05 +08:00
zhang-wei ccb65ff27f
Add `java` -> `go2sky` -> `java` e2e test case, and adapt v3 protocol (#4647)
* go2sky e2e

Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2020-04-15 10:01:11 +08:00
mrproliu 1601cc107c
Support `java` -> `nginx` -> `java` e2e test, and v3 protocol (#4637) 2020-04-11 22:31:28 +08:00
吴晟 Wu Sheng 6fe2041b47
Make 8.0.0 Core available. New protocol and register removed. (#4599)
Here are the list of changes we made in this pull request. Top 3 are the principle changes, others are following these principles.
1. New agent and mesh report protocol. 
2. New agent header protocol. 
3. Service register, instance register and network address register have been removed permanently.
4. Service traffic, instance traffic and network alias metrics are added to replace the service, instance and network address inventory.
5. Register process has been removed.
6. Metrics stream process supports insert only mode, especially for traffic entities.
7. Metrics stream process supports no-downsampling mode for traffic entities and network alias.
8. Remove all register mechanism and cache in the java agent.
9. Remove MONTH step in GraphQL query.
10. Update UI to remove MONTH step query, the max query range is 60 days now.
11. Simplify the TTL to metrics and record. And the unit has been formatted in Day unit. No specific TTL for ElasticSearch storage.
12. Buffer mechanism of trace receiver and mesh receiver has been removed due to no register.
13. New service id, instance id and endpoint id rules, including service relation, instance relation and endpoint relation id rules.
14. Java agent support `keep tracing` mode, meaning, agent generating tracing context even the backend is unconnected/unavailable.
15. Plugin test tool up to date, in order to support new protocol.
16. Plugin tests expected data files updated.
17. E2E tests updated.
18. Telemetry of Grafana config has been merged into one.
19. Documentation updates.
20. [TBD] InfluxDB storage implementation is not available, need @dmsolr to fix later, in order to reduce the master change block by this PR.
2020-04-10 11:03:24 +08:00
吴晟 Wu Sheng 4474907fef
[Inventory Design Change] Remove endpoint register and endpoint inventory (#4570)
* Finish step one, source and entity changed.

* Step 2, finish the basic and core DAO changes.

* Step 3. Change all source codes of backend, and make project compiling successfully.

* Make startup successful and persistence works.

* Fix dead codes in the MySQLTableInstaller.

* Fix mischange.

* Fix MySQL storage bootstrap error.

* Rollback dependency change.

* Simply enable tailing logs from container no mater it's in CI or not

* Fix segment table issue.

* Fix MySQL Instanller.

* Support Influxdb implementation of new endpoint traffic.

* Set and modify timeout to 90mins

* Remove unnecessary entity in the EndpointTraffic.

* Fix wrong entity builder and make name more clear.

* Fix 2 equal methods bug.

* Fix InfluxDB identifier(name) conflict issue.

* Fix endpoint topology query, endpoint id should be changed as a string.

* Fix a missing change.

* Fix a wrong commit.

* Column name can't be changed, due to it affect the hybrid metadb(h2/mysql) query, change it explicitly with double quotation marks.

* Fix formats.

* Remove endpoint/operation register from the agent. and change the plugin tests(without local tests). operationId relation codes have been removed from agent too.

* Try to fix the hytrix case.

* Fix 3 cases.

* Try to fix cases.

* Fix 2.

* Fix one.

* Fix the serviceId type mis-change.

* Fix int query

* Fix hystrix case.

* Fix a case.

* Fix EndpointCallRelationDispatcher set the source/dest endpoint without id encoding.

* Update documentation and add 2 test cases.

Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
2020-03-28 22:51:41 +08:00
kezhenxu94 509b20e7ce
Add JDK13, JDK14 to build matrix (#4574)
Motivation:

Guarantee that the agent supports JDK13 and JDK14

Modifications:

Add JDK13 and JDK14 to build matrix

Result:

Build with JDK13 and JDK14
2020-03-26 22:13:28 +08:00
kezhenxu94 e7f66c911e
[CI] Reorganize the Plugin Tests to speed up the PR checks (#4566) 2020-03-24 23:33:15 +08:00
何延龙 954eede0ec
Add PHP module support to e2e test (#4547) 2020-03-23 23:16:28 +08:00
kezhenxu94 f51ba3a94d
[Chore] Fix license headers and rename E2E job name (#4551)
* Fix license headers and rename E2E job name

* Fix RAT plugin and enable both RAT and checkstyle plugin
2020-03-23 13:51:39 +08:00
cngdkxw 2e9f001633
Add spring cloud feign 2.x plugin (#4526) 2020-03-20 20:28:30 +08:00