Commit Graph

287 Commits

Author SHA1 Message Date
Wu Sheng 00b5149ecf Remove unnecessary moduels 2021-08-26 22:03:53 +08:00
kezhenxu94 c133801dcd
Use skywalking-eyes GHA instead of manually compile (#7524)
Also use `quiet` mode for all maven commands in GHA, we can still see errors when there is failure

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2021-08-21 17:57:45 +08:00
kezhenxu94 cf03304a48
Simplify GitHub workflows by using `uses` in `composite` actions (#7487)
`uses` is recently allowed in `composite` actions, we can simplify our workflows control files further.
2021-08-19 11:47:48 +08:00
kezhenxu94 85e22f5124
Fix issues in ES7.14 and add log cases to ES7.14 (#7429) 2021-08-10 15:36:53 +08:00
wankai123 4e7d80fb88
Support Metric level function `serviceRelation` in `MAL` and binding envoy metrics into the topology. (#7399)
* Support Metric level function `serviceRelation` in `MAL`.
* Support envoy metrics binding into the topology.
* add istio args
* remove istio 1.7

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: Jared Tan <jian.tan@daocloud.io>
Co-authored-by: Zhenxu <kezhenxu94@apache.org>
2021-08-06 17:09:13 +08:00
吴晟 Wu Sheng b903bf17a0
Add ElasticSearch 7.14 to test and bump up OpenSearch version to 1.0 GA (#7415) 2021-08-06 10:36:45 +08:00
kezhenxu94 4003c4b777
Publish snapshot Docker images (#7337) 2021-07-19 22:19:11 +08:00
吴伟杰 06e589fab0
Remove plugins for ShardingSphere legacy and unstable versions (#7323)
Remove the following plugins due to they are legacy and unstable releases.
1. sharding-jdbc-1.5.x-plugin
2. sharding-sphere-4.x-rc3-plugin
3. sharding-sphere-4.x-plugin (This is for RC1 and RC2)

To people who want to use these removing versions, you still could copy the plugins from SkyWalking's 8.6.0 release to the '/plugins' folder to activate, unless SkyWalking has some core level APIs upgrade. This is very rare to happen.
2021-07-18 20:35:54 +08:00
wankai123 9f3ff517d1
Support envoy cluster manager metrics (#7294) 2021-07-16 15:35:48 +08:00
吴晟 Wu Sheng c59ee90029
Performance: optimize IDs read of ElasticSearch storage options(6 and 7) (#7307)
* Performance: optimize IDs read of ElasticSearch storage options(6 and 7). Use the physical index rather than template alias name.
2021-07-15 18:06:11 +08:00
whl12345 9e022d1a73
Provide plugin for Guava Cache (#7235) 2021-07-08 11:58:09 +08:00
Switch 4067fba2ab
Add some new thread metric and class metric to JVMMetric (#7230) (#7243) 2021-07-07 16:30:55 +08:00
Jared Tan 0efc733901
Replace zuul proxy with spring cloud gateway 2.x. in webapp module. (#7220) 2021-07-04 10:24:56 +08:00
liqiangz 0f62d9289f
Add agent plugin to support Sentinel (#7190) 2021-07-03 00:20:14 +08:00
吴伟杰 0975809e43
Add an agent plugin for ShardingSphere 5.0.0-beta (#7171) 2021-06-30 21:00:20 +08:00
wallezhang 1bc69370bf
feat: add neo4j-4.x-plugin (#7099) 2021-06-22 15:36:51 +08:00
kezhenxu94 ab6285c5a4
Add JDK 16 to test matrix, move bom to backend profile (#7139) 2021-06-20 23:24:02 +08:00
kezhenxu94 6caf29733f
Add FluentBit integration E2E test and doc (#7138) 2021-06-20 21:56:45 +08:00
kezhenxu94 9b6c0d1b23
chore: for scheduled tasks, only run on main repo not fork repos (#7121) 2021-06-15 23:49:08 +08:00
Zhenxu 56f2e86a07
CVE: upgrade snakeyaml to prevent billion laughs attack in dynamic configuration. (#7071) 2021-06-05 14:41:46 +08:00
Zhenxu 518843633f
Cancel duplicated workflows (#7043) 2021-05-31 23:10:45 +08:00
吴晟 Wu Sheng a8f2476497
Make all CIs running in ubuntu latest. (#7021) 2021-05-27 09:06:34 +08:00
Lu Jiajing b732ff35a7
Fix ClassCast issue for RequestHolder/ResponseHolder (#6973) 2021-05-22 17:06:13 +08:00
Daming 015d3877cb
Introduce method interceptor v2 (#6937) 2021-05-20 13:36:13 +08:00
Zhenxu Ke 15e112262c
Replace OpenSearch self-built docker image with official one (#6938) 2021-05-14 19:24:23 +08:00
Zhenxu Ke a6828e7da2
Fix some dead links (#6934) 2021-05-13 09:26:28 +08:00
Zhenxu Ke c5e0c01f06
Add OpenSearch as a storage option (#6916) 2021-05-09 10:09:15 +08:00
Zhenxu Ke 3b15f8d132
feature: Envoy access log receiver supports TCP logs (#6727) 2021-05-07 07:50:03 +08:00
ZhangZhaoyuan edc154c40d
Add spring cloud gateway 3.x plugin (#6881) 2021-05-02 11:14:28 +08:00
liqiangz 7a53331367
Support alarm tags (#6820) 2021-04-25 17:22:43 +08:00
guyang e89888668f
feature: jsonrpc4j plugin (#6743) 2021-04-17 22:42:57 +08:00
吴晟 Wu Sheng 64ff0305f7
test: add JDK 15 into test matrix (#6082) 2021-04-12 15:17:20 +08:00
Zhenxu Ke 25214e910a
Collect and report agent starting / shutdown events (#6559) 2021-03-18 15:25:06 +08:00
Zhenxu Ke 0fdb165662
Set up code quality check and fix some (#6519) 2021-03-09 18:15:00 +08:00
Zhenxu Ke 207cef7930
Add Istio 1.9.1 into test matrix (#6476) 2021-03-03 08:29:57 +08:00
John Bampton 85fc4f827c
Fix spelling (#6418) 2021-02-22 07:40:35 +08:00
zhang-wei 1c52995cbf
Supplement the E2E test for skywalking-client-js (#6409) 2021-02-21 22:29:50 +08:00
Zhenxu Ke 9de93119e2
Enhance gRPC log appender to allow layout pattern (#6403) 2021-02-21 12:53:44 +08:00
haoyann c45bb361ee
Storage plugin supports PostgreSQL (#6345) 2021-02-20 20:59:51 +08:00
Zhenxu Ke 1e4a8ee19b
Fix dead links and add checker to detect them (#6394) 2021-02-18 12:31:22 +08:00
mrproliu 75f03acba7
Adopt Zabbix protocol (#6176)
Happy Chinese New Year !!
2021-02-10 22:40:07 +08:00
Zhenxu Ke 30a88b555f
Skip CI in some cases to save resources (#6340) 2021-02-07 16:19:55 +08:00
Zhenxu Ke b92eac2cd6
Add a new concept "Event" and its implementations to collect events (#6183) 2021-02-05 18:37:18 +08:00
Zhenxu Ke 56c264d1fa
test: fix flaky E2E test of Kafka (#6281) 2021-01-30 11:46:05 +08:00
Zhenxu Ke 5d47d4d29f
Remove state / isError and collect exception stacktrace in error logs (#6275) 2021-01-30 08:18:52 +08:00
zhang-wei 01d1eff6c7
Enhancement log-recerive e2e test (#6248) 2021-01-29 00:07:16 +08:00
吴晟 Wu Sheng 7b1c63de11
Remove optional log plugin (#6259) 2021-01-26 23:23:14 +08:00
Daming 9021e67912
fix kafka e2e testing (#6217) 2021-01-16 20:41:46 +08:00
Zhenxu Ke cbfe7ee87c
Set up test for Istio 1.8.2 to verify Envoy V3 protocol (#6215) 2021-01-16 12:44:26 +08:00
Zhenxu Ke 98d0430b91
chore: set up license-eye to check license header (#6200) 2021-01-14 22:08:37 +08:00
zhang-wei 15452025c6
Log collecting and query implementation (#6120) 2021-01-14 09:49:11 +08:00
Zhenxu Ke 34684cefcf
Fix scheduled tasks timezone in GHA (#6161) 2021-01-09 10:36:16 +08:00
Zhenxu Ke afc44d4a3d
Unify the service name rule in `metadata-service-mapping.yml` of `mx-… (#6131) 2021-01-08 13:54:04 +08:00
Zhenxu Ke f3d5153a80
Add ElasticSearch 7.10 to test matrix (#6137) 2021-01-07 10:11:13 +08:00
Zhenxu Ke f54f639c4d
Enhance Envoy metrics service analyzer by MAL (#6091) 2021-01-02 14:34:54 +08:00
vcjmhg c010481cf6
Checkstyle plugin checks test codes (#6003) 2020-12-29 17:58:34 +08:00
Zhenxu Ke 462c685836
Update cancel.yaml to use ASF GHA (#6087) 2020-12-27 23:16:41 +08:00
Zhenxu Ke d4175d84b1
test: add e2e for NodeJS agent (#6073) 2020-12-24 16:07:07 +08:00
Zhenxu Ke 6feeaf6e5f
Update submodule to sync namespaced proto files (#6026)
* update submodule to sync namespaced proto files

* add compat E2E test and update mock collector

* add changelog, fix GHA syntax, compat Java agent

* highlight notes, use archive dist, revert compat in agent

* polish changelog, add missing `-javaagent` in provider

* fix wrong position of JAVA_OPTS

* polish changelog
2020-12-18 12:29:44 +08:00
vcjmhg 0996151973
Support collecting logs of log4j, log4j2, and logback in the tracing context (#5914) 2020-12-10 13:53:30 +08:00
mrproliu 4aa9f301d0
Add alarm tests in the e2e (#5961) 2020-12-08 16:47:28 +08:00
Zhenxu Ke b5367aa6b1
test: extract so11y test and add logs (#5955)
* Increase metrics time range
* Remove unused codes
* Update SO11yE2E.java

Co-authored-by: Hongtao Gao <hanahmily@gmail.com>
2020-12-06 22:15:37 +08:00
zifeihan 6e0a244482
Add the plugin for Apache CXF 3.x (#5887) 2020-11-26 17:18:55 +08:00
Lu Jiajing d9623ec487
Spring-Kafka 1.x support (#5879)
* support spring-kafka 1.3.x and add test

* add spring-kafka-1.3.x-scenario to github workflow

* change kafka-plugin FAQ

* add supported versions

* update CHANGES.md
2020-11-24 19:32:37 +08:00
Jared Tan 8d164d3dd8
Add Tidb provider module. (#5844)
* fix transaction too large error when use TiDB as storage

* add CHANGES.md

* fix typo

* add tidb storage provider module.

* add e2e.

* revert ui submodule.

* fix license.

* Fix wrong health check test

* add tidb ttl e2e.

Co-authored-by: moonsphere <moonsphere@m.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
2020-11-22 23:28:54 +08:00
zifeihan d6c9926e9e
Add the plugin for microsoft mssql-jdbc (#5856) 2020-11-18 15:48:18 +08:00
zifeihan 7220643cbf
Add the plugin for mssql-jtds 1.x plugin. (#5842)
* Add the plugin for mssql-jtds 1.x plugin.
2020-11-16 08:30:25 +08:00
kezhenxu94 8da9bf94ab
ALS analyzer based on Envoy metadata exchange (#5800) 2020-11-09 00:01:12 +08:00
King bc7afa6347
add support for dbcp 2.x plugin (#5550) 2020-11-08 09:41:56 +08:00
Kcat c32caab6e0
Add async-http-client plugin (#5690) 2020-11-06 00:33:47 +08:00
Jarek Potiuk b041ecb2a9
The Cancel step is now optimised in one job (#5782)
The cancel steps were tried in separate jobs but it causes
an unnecessary increase in the number of jobs blocking the queue
even if we limited parallelism. This PR combines all the cancel
actions into a single job with multiple steps.

While this is a bit more copy&pasting and less DRY it is also
far more optimised and "aggressive" - i.e. once any cancel
job starts to be running it will immediately cancel all duplicates
for all workflows.
2020-11-03 19:31:36 +08:00
kezhenxu94 66dd848e84
test: E2E Elasticsearch 7.x highest and lowest versions (#5779) 2020-11-03 16:42:13 +08:00
Jarek Potiuk 63c016d3f6
Simplifies canceling workflow (#5776)
Instead of multiple workflow-runs generated for different workflows
this change replces it with single workflow, cancelling all others.
It is triggered by only one CI-IT workflow, because this one is
always triggered when all others are. It also sets parallelism
of the matrix to 4, so that there are not too many jobs in
parallel taken when this workflow runs.
2020-11-03 14:31:24 +08:00
吴晟 Wu Sheng 19752ad098
Upgrade the cancel plugin (#5766) 2020-11-02 10:40:25 +08:00
kezhenxu94 a5300880d7
[CI] Cancel outdated jobs when new builds are fired (#5558) 2020-11-02 00:19:57 +08:00
Evan 603187b7a8
Apply tags from Correlation Context key/values to Spans (#5685)
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
2020-11-01 20:51:21 +08:00
kezhenxu94 92bb474c2d
Improve Kubernetes service registry for ALS analysis (#5722)
The current implementation of envoy ALS K8S analysis is based on the hierarchy, pod -> StatefulSet -> deployment, StatefulSet, or others. It's freaky and different from the Istio Kubernetes registry.

The new path is pod -> endpoint -> service, and we should leverage Informer API instead of raw Kubernetes API.
2020-10-29 18:22:38 +08:00
Daming 0c4827d056
remove finagle-6.25.0-scenario (#5747) 2020-10-29 07:50:57 +08:00
Daming 98968122e9
Provide Thrift Plugin (#5644) 2020-10-16 16:09:47 +08:00
kezhenxu94 d113f58645
test: add a tool to select a suitable group for a new plugin test and remove the outdated group size of plugin tests (#5676) 2020-10-16 08:44:55 +08:00
kezhenxu94 239eaa01fd
test: set up ALS E2E test (#5675) 2020-10-15 23:20:46 +08:00
吴晟 Wu Sheng 235fbe729c
Fix 3 format issue of CI control file. (#5625)
* Fix 3 format issue of CI control file.

* Fix more.
2020-10-02 18:17:55 +08:00
吴晟 Wu Sheng 2b737e24e4
Embrace the maven cache in the GitHub action. (#5619)
* Add cache for maven local repo.

* FIx formats.
2020-10-01 19:05:28 +08:00
吴晟 Wu Sheng 103cf00672
Support JDK 11 compiling and upgrade dependencies (#5579)
* Upgrade dependencies and make the JDK11 compiling passed.

* Update license and fix license check file.

* Add CI for JDK11 compiling.

* Update doc.
2020-09-29 10:34:21 +08:00
Xin,Zhang f3967840c5
Fix the failure of Oracle scenario (#5540) 2020-09-23 07:47:55 +08:00
harvies c33a55cda1
Test for mongo3.x support version (#5539) 2020-09-22 22:08:58 +08:00
harvies 1ff25ac4f4
Support mongo driver 4.x version. (#5512) 2020-09-22 17:09:24 +08:00
hailin0 e200ef1045
Add support for xxl-job (#5519) 2020-09-20 10:04:32 +08:00
Evan 29de696c42
exception-ignore-plugin (#5426) 2020-09-09 15:07:01 +08:00
zhang-wei 7ef8b3e476
Support Browser protocol at OAP (#4228) 2020-08-31 15:46:37 +08:00
hailin0 ca957699dc
Add support for quartz-scheduler (#5413) 2020-08-30 23:48:26 +08:00
hailin0 afc0aef567
Add logic-endpoint and testcase for elasticjob-2.x plugin (#5395) 2020-08-28 14:27:07 +08:00
Xin,Zhang 77d94b4d2a
Fix issue that spring mvc plugin doesn't works when running on reactive api (#5360) 2020-08-26 13:22:39 +08:00
Daming 6c1659c56a
[plugin/test] Plugin test with jdk14 (#5352)
* plugin test with jdk14

* introduce jdk14 container

* remove docker:build

* remove BUILD_NO and introduct image_version

* Update docs/en/guides/Plugin-test.md

Co-authored-by: kezhenxu94 <kezhenxu94@163.com>

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
2020-08-24 20:17:22 +08:00
hailin0 1b54b61a88
Add support for spring @Scheduled (#5339) 2020-08-23 17:13:49 +08:00
Evan 68317dd910
Add agent plugins selector (#5293) 2020-08-14 15:06:30 +08:00
于玉桔 e37fc2e439
Support spring-kafka (#5254) 2020-08-10 19:13:19 +08:00
于玉桔 69297b9ec6
Support Apache ShardingSphere-Elasticjob (#5153) 2020-08-10 10:48:23 +08:00
于玉桔 7a20c260bb
Add HBase hbase-client plugin (#5225) 2020-08-05 17:55:20 +08:00
Daming f9257f5274
Provide kafka as collector/reporter (#4847) 2020-07-30 11:55:49 +08:00
mrproliu 925c0d74c7
Provide server-side meter (#4972) 2020-07-25 21:17:32 +08:00
caoyixiong 80a534b1bb
support Graphql Logic endpoint (#5030) 2020-07-05 23:37:09 +08:00
gongdewei 1817386391
Support cache mode in the agent. (#4858) 2020-07-01 23:20:50 +08:00
caoyixiong 31f42343f6
add brpc-java plugin (#4958) 2020-06-27 14:57:29 +08:00
dagmom 08897ce5f8
New feature provided : new plugin for influxdb-java client (#4846) 2020-06-21 22:35:45 +08:00
于玉桔 c778a0d6c2
Support Quasar fiber tracing (#4951) 2020-06-20 22:30:03 +08:00
xiaoyu 164124fc22
provider shardingSphere 4.0.0 4.0.1 plugin. (#4927) 2020-06-15 17:03:17 +08:00
xiaoyu a24efcf5e9
ShardingSphere plugins conflict among themselves. (#4921)
* Fix shardingSphere plugin test fail if have some same ENHANCE_CLASS define.

* support 4.1.0 and 4.1.1

* support 4.1.0 and 4.1.1
2020-06-14 18:48:07 +08:00
吴晟 Wu Sheng 5de0d2c6f6
Set version to 8.1.0 for next iteration. (#4916)
* [maven-release-plugin] prepare release v8.0.0

* [maven-release-plugin] prepare for next development iteration

* Remove all shardingsphere cases.
2020-06-12 23:44:42 +08:00
Xin,Zhang 7b99019c49
Refactory spring gateway plugin (#4878) 2020-06-12 00:25:41 +08:00
何延龙 305a6b3032
[PHP-E2E] Support v8 (#4862) 2020-06-05 18:02:44 +08:00
Brandon Fergerson 705f97f27a
Increased Vert.x support (#4840) 2020-06-01 21:00:16 +08:00
Brandon Fergerson 594fb15b53
Increased support for Vertx (#4827) 2020-05-26 22:02:34 +08:00
kezhenxu94 576bd7e286
Test: add E2E test for Python Agent (#4770) 2020-05-11 16:05:06 +08:00
Efe Kaptan d19ba41678
Mariadb JDBC plugin (#4740)
* Add Mariadb JDBC plugin and provide tests

* Refactor component name

* Reformat plugin description and remove healthcheck span from the test

Co-authored-by: Efe Kaptan <Efe.Kaptan@webtrekk.com>
Co-authored-by: zhang-wei <pknfe@outlook.com>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-05-07 20:54:30 +08:00
Brandon Fergerson 4fc57a6663
Increase Vert.x Compatability (#4736)
* vertx web plugin re-impl attempt

* added license

* update test for new plugin structure

* got rid of registryItems

* remove unnecessary dependencies

* re-impl eventbus scenario

* more precise naming

* fix expected data

* removed unsupported versions and removed vertx caching (avoids permission error)

* rewrote to remove copied code

* Update plugins-test.3.yaml

* fixes issue of .vertx files remaining on v3.0.0

* only present in v3.0.0

* consistency

* add more supported versions

* track status code

* spelling fix

* track status code

* more correct naming

* reverts 213f5a69 (status code isn't sent at this point)

* made HttpServerResponseImplEndInstrumentation more strict based on version
added status code tracking
fixes issue not finishing async spans

* works 3.0.0,3.7.0

* increase compatibility

* 3.9.0 default

* versioned witness classes (advice from wu-sheng)

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: zhang-wei <pknfe@outlook.com>
2020-05-01 17:06:46 +08:00
kezhenxu94 4a8f86f817
Use the built-in ability to check out submodules (#4728) 2020-04-28 20:32:56 +08:00
Brandon Fergerson 776d508018
Vertx plugin test re-implementation (#4624)
* vertx web plugin re-impl attempt
2020-04-24 19:49:03 +08:00
Daming 44f1b4a4ff
[test/plugin] Enhance PluginTest (#4677)
1. Re-balance the workload of plugintests
2. Restore testcases of MySQL, remove on #4641
3. Support user to runs plugin-test on debug mode. It will not remove the log files and actualData.yaml
4. remove paramater 'parallel_run_size' and disable parallel test.
2020-04-22 20:43:17 +08:00
kezhenxu94 8e6a527f78
Add Java versions 9~14 to E2E tests (#4674) 2020-04-21 13:45:32 +08:00
Daming 28530cd79d
Upgrade the InfluxDB storage-plugin to protocol V3 (#4641)
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2020-04-19 20:10:59 +08:00
kezhenxu94 c11ad038cc
Count the coverage in E2E tests and Plugin tests (#4651) 2020-04-15 23:09:05 +08:00
zhang-wei ccb65ff27f
Add `java` -> `go2sky` -> `java` e2e test case, and adapt v3 protocol (#4647)
* go2sky e2e

Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2020-04-15 10:01:11 +08:00
mrproliu 1601cc107c
Support `java` -> `nginx` -> `java` e2e test, and v3 protocol (#4637) 2020-04-11 22:31:28 +08:00
吴晟 Wu Sheng 6fe2041b47
Make 8.0.0 Core available. New protocol and register removed. (#4599)
Here are the list of changes we made in this pull request. Top 3 are the principle changes, others are following these principles.
1. New agent and mesh report protocol. 
2. New agent header protocol. 
3. Service register, instance register and network address register have been removed permanently.
4. Service traffic, instance traffic and network alias metrics are added to replace the service, instance and network address inventory.
5. Register process has been removed.
6. Metrics stream process supports insert only mode, especially for traffic entities.
7. Metrics stream process supports no-downsampling mode for traffic entities and network alias.
8. Remove all register mechanism and cache in the java agent.
9. Remove MONTH step in GraphQL query.
10. Update UI to remove MONTH step query, the max query range is 60 days now.
11. Simplify the TTL to metrics and record. And the unit has been formatted in Day unit. No specific TTL for ElasticSearch storage.
12. Buffer mechanism of trace receiver and mesh receiver has been removed due to no register.
13. New service id, instance id and endpoint id rules, including service relation, instance relation and endpoint relation id rules.
14. Java agent support `keep tracing` mode, meaning, agent generating tracing context even the backend is unconnected/unavailable.
15. Plugin test tool up to date, in order to support new protocol.
16. Plugin tests expected data files updated.
17. E2E tests updated.
18. Telemetry of Grafana config has been merged into one.
19. Documentation updates.
20. [TBD] InfluxDB storage implementation is not available, need @dmsolr to fix later, in order to reduce the master change block by this PR.
2020-04-10 11:03:24 +08:00
吴晟 Wu Sheng 4474907fef
[Inventory Design Change] Remove endpoint register and endpoint inventory (#4570)
* Finish step one, source and entity changed.

* Step 2, finish the basic and core DAO changes.

* Step 3. Change all source codes of backend, and make project compiling successfully.

* Make startup successful and persistence works.

* Fix dead codes in the MySQLTableInstaller.

* Fix mischange.

* Fix MySQL storage bootstrap error.

* Rollback dependency change.

* Simply enable tailing logs from container no mater it's in CI or not

* Fix segment table issue.

* Fix MySQL Instanller.

* Support Influxdb implementation of new endpoint traffic.

* Set and modify timeout to 90mins

* Remove unnecessary entity in the EndpointTraffic.

* Fix wrong entity builder and make name more clear.

* Fix 2 equal methods bug.

* Fix InfluxDB identifier(name) conflict issue.

* Fix endpoint topology query, endpoint id should be changed as a string.

* Fix a missing change.

* Fix a wrong commit.

* Column name can't be changed, due to it affect the hybrid metadb(h2/mysql) query, change it explicitly with double quotation marks.

* Fix formats.

* Remove endpoint/operation register from the agent. and change the plugin tests(without local tests). operationId relation codes have been removed from agent too.

* Try to fix the hytrix case.

* Fix 3 cases.

* Try to fix cases.

* Fix 2.

* Fix one.

* Fix the serviceId type mis-change.

* Fix int query

* Fix hystrix case.

* Fix a case.

* Fix EndpointCallRelationDispatcher set the source/dest endpoint without id encoding.

* Update documentation and add 2 test cases.

Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
2020-03-28 22:51:41 +08:00
kezhenxu94 509b20e7ce
Add JDK13, JDK14 to build matrix (#4574)
Motivation:

Guarantee that the agent supports JDK13 and JDK14

Modifications:

Add JDK13 and JDK14 to build matrix

Result:

Build with JDK13 and JDK14
2020-03-26 22:13:28 +08:00
kezhenxu94 e7f66c911e
[CI] Reorganize the Plugin Tests to speed up the PR checks (#4566) 2020-03-24 23:33:15 +08:00
何延龙 954eede0ec
Add PHP module support to e2e test (#4547) 2020-03-23 23:16:28 +08:00
kezhenxu94 f51ba3a94d
[Chore] Fix license headers and rename E2E job name (#4551)
* Fix license headers and rename E2E job name

* Fix RAT plugin and enable both RAT and checkstyle plugin
2020-03-23 13:51:39 +08:00
cngdkxw 2e9f001633
Add spring cloud feign 2.x plugin (#4526) 2020-03-20 20:28:30 +08:00
kezhenxu94 dcd66ee6e9
Rewrite the E2E test framework and tests (#4510)
Motivation:

According the feedback from the community, the e2e tests are hard for
them to understand and get them started, so this pull request aims to
rewrite the e2e tests with some improvements:

- debuggable locally, now you can run every individual case directly
inside the IDE, just like running a plain unit test.

- same functionalities of multiple counterparts share the same codes,
cases like different storages and cluster coordinators share the same
codes, easy to add more similar cases.

- the "end" now extends to the Doccker images, meaning that some bugs
like #4483 and #4471 can be more easily and early to be discovered.

- codes style and license headers are checked

Modifications:

- adopt jupeter (a.k.a junit 5), testcontainers as the new test
framework, all containers are orchestrated by docker-compose.yml,
well-known technology that developers should be familiar with.

- rewrite all test cases and verify them.

- reorganize the workflows in GitHub Actions.

Result:

- new e2e test should be easy to add.

- closes https://github.com/apache/skywalking/issues/4472
2020-03-16 23:45:14 +08:00
kezhenxu94 69e3d80e24
Add selector property in application.yml (#4514)
### Motivation

 Ease the efforts of modifying configurations in automatic workflow and scripts, like Docker and helm chart.

 ### Modification

 Add a `selector` property into `application.yml` to enable switching configuration simply by environment variables or system properties, and filter the unselected options, leaving only selected one.

 ### Result

 - We can switch a configuration by environment variables or system property

 - Closes #4511
2020-03-15 23:28:14 +08:00
Gao Hongtao 78d14ebbd6
Enable OAP gRPC SSL transportation (#4470)
* Enable OAP gRPC SSL transportation

Porting to OpenSSL to enable SSL transportation. The server private
key is in the format of PCKS#8, certificates is x509 though.

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Add netty-tcnative-boringssl-static 2.0.26 licnese

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Update docs/en/setup/backend/grpc-ssl.md

Co-Authored-By: kezhenxu94 <kezhenxu94@apache.org>

* Update docs/en/setup/backend/grpc-ssl.md

Co-Authored-By: kezhenxu94 <kezhenxu94@apache.org>

* Add SSL to grpc remote client and sharing server

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Update documents

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Fix nits

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Fix test case

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Add e2e-ssl and remove other test cases temporarily

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Add TLS relevant files

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Decrease timeout

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Test config works

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* triger CI on oap-ssl branch

* Disable agent ca

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Switch to sharing server

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Add agent log to console

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Upload log files

* Change backend

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Revert "Change backend"

This reverts commit 7a085711e3653d3bf642aa84f73650e22595e383.

* Update backend

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Revert e2e

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Ignore TSL relevant files

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Polish codes

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Update certificates expires year to 2120

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2020-03-15 08:15:28 +08:00
cngdkxw d5efc97c80
RestTemplate async plugin ClassCastException (#4507)
* ClassCastException

* resttemplate 4.x scenario

* add support versions & fix expectedData format-

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-03-13 23:13:51 +08:00
Gao Hongtao fdb816c799
Update MiniKube for CI process (#4495)
* Update pre.sh

* add if func

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Reorder steps

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Upgrade minikube to 1.8.0

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-03-12 10:33:11 +08:00
yoje ced5cb2828
Add finagle plugin (#4441)
* Add finagle plugin (#4433)

* fix failed checks for pr(#4441)
* Add licenses for some files
* Update Supported doc
* Add finagle to test component-libraries.yml

* Add finagle automatic tests into CI

* Add comments

* update comments

* Remove CompatibilityChecker

* Move query-protocol submodule to the right version

* Remove `enhancedInstance.setSkyWalkingDynamicField` in `ClientTracingFilterInterceptor`.

* Update expectedData.yaml of finagle tests

* Use lazy ContextCarrier injection.

* Add comments for `ContextCarrierHelper`

* Fix ContextHolderFactory to avoid context pollution

Co-authored-by: huangyongjie <huangyongjie@tigerbrokers>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-03-11 13:04:58 +08:00
Jared Tan aa21765628
support http api for upstream trace. (#4399)
* support http api.

* e2e

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2020-03-06 21:07:39 +08:00
Jared Tan 85cc9c36ac
fix agent auth e2e not activated. (#4428)
* fix e2e miss.
2020-02-29 22:20:43 +08:00
aderm 467ef8bffc
Update to actions/checkout@v2, fix checks error: reference is not a tree. (#4419) 2020-02-27 22:31:58 +08:00
zhang-wei 2ac2d2555a
[test/plugin] immigrate h2 & struts scenario (#4395)
* immigrate test code

* enhance mysql case healthCheck

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-02-23 20:34:44 +08:00
Daming 29da5738bc
Provide influxdb as a new storage plugin (#4239)
* provide influxdb as a new storage plugin

Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-02-19 18:00:57 +08:00
aderm 8c96fd49dd Update elasticsearch-7.x agent support version. (#4340)
* test/plugin/scenarios/elasticsearch-7.x-scenario/support-version.list

* update elasticsearch-7.x agent support version.

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-02-10 19:10:38 +08:00
kezhenxu94 408a777d9d
Make traces verification loosely (#4306)
### Motivation:

Make E2E tests more stable.

### Modifications:

Verify the traces loosely as other tests, and remove the `verify` method which verifies traces strictly, as we have preparation that also generates traces.

### Result:

E2E tests are more stable.
2020-02-02 14:11:47 +08:00
Daming 9005d1e82c
Provide AVRO plugin (#4276)
* Provide Avro plugin
* provide testcase for avro-plugin

Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
2020-01-30 17:49:43 +08:00
mrproliu 8e4c1e95d6 Merge e2e profile test project (#4268)
* merge e2e profile test project, Use `env` to distinguish different storage types

* remove maven child module

* change `env` -> `storage`

Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
2020-01-20 19:34:53 +08:00
吴晟 Wu Sheng 9149de2a6e Support multiple linear values and merging p50/75/90/95/99 into percentile (#4214)
* Support new percentile func with new alarm and exporter for this new func.

* Fix e2e and OAL script

* Fix wrong column.

* Fix percentile bug and oal engine bug.

* Update query protocol and add percentile test case

* Support new query

* Adopt GraphQL requirement

* Fix wrong type cast.

* Fix query in H2 and ES.

* Fix docs and comments.

* Fix an e2e compile issue

* Fix javadoc issue and e2e test issue.

* Change CPM to Apdex in TTL test.

* Fix OAL for TTL e2e

* Add metrics query for service percentile.

* Fix OAL engine bug. Method deserialize is not working when more than two field types are IntKeyLongValueHashMap

* Support multiple IntKeyLongValueHashMap fields in remote. About serialize/deserialize methods.

* Fix graphql statement error in e2e.

* Fix serialize not working and add generated serialize/deserialize of percentile into test cases.

* Fix test case format

* Remove generated code test.

* Fix failed e2e test

* Use avg resp time to apdex in the TTL test.

* ADD multiple linear metrics check for endpoint in e2e cluster.

* Support `-` to represent no threshold and doc of alarm about this.

* Move break to right place.

* Fix wrong break(s)

* Fix break and add a test case for multiple values alarm.

* Fix format.

* Add more doc for this new feature and GraphQL query protocol.

Co-authored-by: Jared Tan <jian.tan@daocloud.io>
Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
2020-01-12 22:10:50 +08:00
dengliming 1881a040d4 Support plugin for mongodb v3.6.x (#4173)
* feat: add support plugin of mongodb v3.6.x

* update support-version.list

* update Supported-list.md

* update Supported-list.md

* Add witness class for v3.6

* update plugins-test.yaml

Co-authored-by: zhang-wei <pknfe@outlook.com>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: Weiyi Liu <liuweiyi@cmss.chinamobile.com>
2020-01-07 14:25:19 +08:00
Gao Hongtao 8d0c3b912f Add es7 support to docker (#4043)
* Add es7 support to docker

* Add es7 to github aciton workflow

* Rename dockerfile

* Update docker-compose

* Update matrix es name

* Set oap tag

* Add document

* Update How-to-build.md
2020-01-05 17:08:14 +08:00
Kanro 4e03d5e6d7 Add kotlin coroutine plugin (#4165)
* Kotlin coroutine plugin write in Java

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-01-04 22:51:59 +08:00