Commit Graph

535 Commits

Author SHA1 Message Date
Leon Yang 56425f1c62
support jedis pipeline (#6565) 2021-03-20 19:52:28 +08:00
Daming c2fa8baf5c
Improvement lua e2e case (#6553) 2021-03-16 13:34:17 +08:00
Evan fd1d21021f
[Incompatible Enhancement]New index policy of ElasticSearch storage option (#6499) 2021-03-11 15:11:37 +08:00
hailin0 0382447749
Fix tags store of log and trace on h2/mysql/pg storage (#6505) 2021-03-11 10:40:54 +08:00
Zhenxu Ke 0fdb165662
Set up code quality check and fix some (#6519) 2021-03-09 18:15:00 +08:00
Jingguo Yao 20425c3aa5
Add test cases for kafka-plugin (#6503)
1. Add plugin test for KafkaProducer.send(record).
2. Add exception checking test cases for CallbackInterceptor.
2021-03-07 21:48:46 +08:00
hailin0 78487ad983
Upgrade lombok to 1.18.16 (#6506) 2021-03-07 18:54:45 +08:00
Zhenxu Ke cb16e524da
Enhance the LAL to allow easily skipping logs with malformed formats (#6477) 2021-03-03 17:18:50 +08:00
Zhenxu Ke de6a731d72
Save Envoy http access logs when error occurs (#6322) 2021-03-02 22:40:30 +08:00
Zhenxu Ke 77082de77b
Add `sum` function in meter system (#6427)
* Add `sum` function in meter system

* Fix minor potential bug and reformat some codes

* Fix a bug

* Use Set to hold the {aggregate,scope} labels as same labels maybe added by multiple aggregation functions

* Separate downsampling function and revert unnecessary codes
2021-02-25 15:10:28 +08:00
lipenghui 08bceb90eb
Add pulsar version 2.6.3 and 2.7.0 (#6438) 2021-02-25 08:14:56 +08:00
Zhenxu Ke 96f1c12159
Introduce log analysis language (LAL) (#6388) 2021-02-23 20:06:48 +08:00
Daming 1d4ff66719
Update Dockerfile.nginx (#6421) 2021-02-23 12:09:46 +08:00
John Bampton 85fc4f827c
Fix spelling (#6418) 2021-02-22 07:40:35 +08:00
zhang-wei 1c52995cbf
Supplement the E2E test for skywalking-client-js (#6409) 2021-02-21 22:29:50 +08:00
Zhenxu Ke 9de93119e2
Enhance gRPC log appender to allow layout pattern (#6403) 2021-02-21 12:53:44 +08:00
mrproliu 317a6580f3
Remove filename suffix in the meter active file config (#6413) 2021-02-21 08:35:38 +08:00
haoyann c45bb361ee
Storage plugin supports PostgreSQL (#6345) 2021-02-20 20:59:51 +08:00
wankai123 6c6a8a7109
Add E2E test for VM monitoring that the metrics from Promethues node-exporter via OTEL. (#6404) 2021-02-20 16:11:44 +08:00
mrproliu e60950c5c3
Change the Zabbix receiver is disabled by default (#6395) 2021-02-18 23:45:18 +08:00
Evan ecd0213587
Fix the incorrect package imports of the log4j grpc log appender. (#6385) 2021-02-17 17:27:26 +08:00
mrproliu 75f03acba7
Adopt Zabbix protocol (#6176)
Happy Chinese New Year !!
2021-02-10 22:40:07 +08:00
Zhenxu Ke 30a88b555f
Skip CI in some cases to save resources (#6340) 2021-02-07 16:19:55 +08:00
zhang-wei ba6d49ad91
Update the timestamp field type for LogQuery (#6335) 2021-02-07 12:09:51 +08:00
Zhenxu Ke b92eac2cd6
Add a new concept "Event" and its implementations to collect events (#6183) 2021-02-05 18:37:18 +08:00
Zhenxu Ke 56c264d1fa
test: fix flaky E2E test of Kafka (#6281) 2021-01-30 11:46:05 +08:00
Zhenxu Ke 5d47d4d29f
Remove state / isError and collect exception stacktrace in error logs (#6275) 2021-01-30 08:18:52 +08:00
zhang-wei 01d1eff6c7
Enhancement log-recerive e2e test (#6248) 2021-01-29 00:07:16 +08:00
吴晟 Wu Sheng 7b1c63de11
Remove optional log plugin (#6259) 2021-01-26 23:23:14 +08:00
zhang-wei 0bd8149596
LogQuery remove unused field (#6246) 2021-01-24 19:13:31 +08:00
zifeihan 97f54114a5
Add the implementation of ConfigurationDiscovery on the OAP side. (#6220) 2021-01-19 14:53:49 +08:00
ralphgj ea8a4963a2
fix recording url tag with wrong port (#6214) 2021-01-18 19:49:33 +08:00
Evan 020a995301
change spanId toolkit api type (#6216) 2021-01-16 15:40:48 +08:00
Zhenxu Ke cbfe7ee87c
Set up test for Istio 1.8.2 to verify Envoy V3 protocol (#6215) 2021-01-16 12:44:26 +08:00
Evan b0cc91382c
export the segmentId and spanId in toolkit (#6213) 2021-01-16 09:04:01 +08:00
Zhenxu Ke 98d0430b91
chore: set up license-eye to check license header (#6200) 2021-01-14 22:08:37 +08:00
zhang-wei 15452025c6
Log collecting and query implementation (#6120) 2021-01-14 09:49:11 +08:00
Jared Tan 50c74a6bc5
Upgrade kafka clients support version (#6182) 2021-01-12 21:49:22 +08:00
Zhenxu Ke afc44d4a3d
Unify the service name rule in `metadata-service-mapping.yml` of `mx-… (#6131) 2021-01-08 13:54:04 +08:00
Zhenxu Ke f3d5153a80
Add ElasticSearch 7.10 to test matrix (#6137) 2021-01-07 10:11:13 +08:00
Zhenxu Ke f54f639c4d
Enhance Envoy metrics service analyzer by MAL (#6091) 2021-01-02 14:34:54 +08:00
vcjmhg c010481cf6
Checkstyle plugin checks test codes (#6003) 2020-12-29 17:58:34 +08:00
Zhenxu Ke d4175d84b1
test: add e2e for NodeJS agent (#6073) 2020-12-24 16:07:07 +08:00
Zhenxu Ke 7b9cff4b73
chore: fix typo gprc -> grpc (#6035) 2020-12-20 00:17:46 +08:00
zifeihan de3ccecd22
Trace method(clearScrollAsync) for elasticsearch-6.x-plugin and polishing elasticsearch-6.x-scenario. (#6031)
* Polish elasticsearch-6.x-scenario.
2020-12-19 20:58:07 +08:00
Zhenxu Ke 6feeaf6e5f
Update submodule to sync namespaced proto files (#6026)
* update submodule to sync namespaced proto files

* add compat E2E test and update mock collector

* add changelog, fix GHA syntax, compat Java agent

* highlight notes, use archive dist, revert compat in agent

* polish changelog, add missing `-javaagent` in provider

* fix wrong position of JAVA_OPTS

* polish changelog
2020-12-18 12:29:44 +08:00
vcjmhg 0996151973
Support collecting logs of log4j, log4j2, and logback in the tracing context (#5914) 2020-12-10 13:53:30 +08:00
mrproliu 4aa9f301d0
Add alarm tests in the e2e (#5961) 2020-12-08 16:47:28 +08:00
hailin0 fbf49b2cc6
Change the operation name of quartz-scheduler plugin (#5934) 2020-12-08 10:04:14 +08:00
Zhenxu Ke b5367aa6b1
test: extract so11y test and add logs (#5955)
* Increase metrics time range
* Remove unused codes
* Update SO11yE2E.java

Co-authored-by: Hongtao Gao <hanahmily@gmail.com>
2020-12-06 22:15:37 +08:00
zifeihan c24dbd6ec1
Fix jdk-http and okhttp-3.x plugin did not overwrite the old trace header. (#5958)
* Fix jdk-http and okhttp-3.x did not overwrite the old trace header.

* Update CHANGES.md.
2020-12-06 21:14:12 +08:00
Zhenxu Ke 7c406c30ce
test: remove so11y from SimpleE2E (#5957) 2020-12-06 15:27:57 +08:00
zifeihan 6e0a244482
Add the plugin for Apache CXF 3.x (#5887) 2020-11-26 17:18:55 +08:00
Gao Hongtao 53e42bce5d
Insert group name into services of so11y and istio relevant metrics (#5897) 2020-11-26 14:38:10 +08:00
Gao Hongtao b39c4306a8
Observing Istio control plane (#5835)
* Add Istio control plane otel MAL expressions and UI template
* Remove OpenCensus receiver, add OpenTelemetry receiver
* Transfer oc receiver to ot receiver
* Create indices on boot
* Document istio metrics and otel receiver
* Update CHANGES.md
* Fix potential NPE
* Add group to meter and cleanup istio mixer
* Update e2e case due to the change of meter metric name
* Update prometheus fetcher config, fix sql builder issue of h2
* Disable istio and so11y metrics by default.
* Fix micrometer testcase
2020-11-25 21:07:03 +08:00
Lu Jiajing d9623ec487
Spring-Kafka 1.x support (#5879)
* support spring-kafka 1.3.x and add test

* add spring-kafka-1.3.x-scenario to github workflow

* change kafka-plugin FAQ

* add supported versions

* update CHANGES.md
2020-11-24 19:32:37 +08:00
Jared Tan 8d164d3dd8
Add Tidb provider module. (#5844)
* fix transaction too large error when use TiDB as storage

* add CHANGES.md

* fix typo

* add tidb storage provider module.

* add e2e.

* revert ui submodule.

* fix license.

* Fix wrong health check test

* add tidb ttl e2e.

Co-authored-by: moonsphere <moonsphere@m.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
2020-11-22 23:28:54 +08:00
zifeihan d6c9926e9e
Add the plugin for microsoft mssql-jdbc (#5856) 2020-11-18 15:48:18 +08:00
吴晟 Wu Sheng 9c486a05ee
Support `sideCar.internalErrorCode` in the sources (#5849)
* Support nested sidecar object in the scope.

* Update the changelog.

* Fix comments and docs.
2020-11-17 09:03:48 +08:00
zifeihan 7220643cbf
Add the plugin for mssql-jtds 1.x plugin. (#5842)
* Add the plugin for mssql-jtds 1.x plugin.
2020-11-16 08:30:25 +08:00
kezhenxu94 b93de289d3
test: work around the testcontainers bug (#5808) 2020-11-09 06:53:13 +08:00
kezhenxu94 8da9bf94ab
ALS analyzer based on Envoy metadata exchange (#5800) 2020-11-09 00:01:12 +08:00
King bc7afa6347
add support for dbcp 2.x plugin (#5550) 2020-11-08 09:41:56 +08:00
xiaoyu d625f2905b
shardingsphere scenario remove commons-dbcp (#5788) 2020-11-07 20:34:57 +08:00
kezhenxu94 b69aff1e2b
Bump up testcontainers version to workaround the Docker bug on MacOS (#5807) 2020-11-07 17:25:32 +08:00
Kcat c32caab6e0
Add async-http-client plugin (#5690) 2020-11-06 00:33:47 +08:00
kezhenxu94 66dd848e84
test: E2E Elasticsearch 7.x highest and lowest versions (#5779) 2020-11-03 16:42:13 +08:00
Evan 603187b7a8
Apply tags from Correlation Context key/values to Spans (#5685)
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
2020-11-01 20:51:21 +08:00
zifeihan ac36a3ff49
Add ThreadPoolExecutor for handle kafka message. (#5718)
* 1.Add ThreadPoolExecutor for handle kafka message.

Co-authored-by: Daming <zteny@foxmail.com>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-11-01 15:28:14 +08:00
Evan 08781b41a8
add transmission latency for MQ case (#5666)
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2020-11-01 11:01:04 +08:00
xbkaishui 9668672205
add http client parameter collector (#5756)
* add http client parameter collector
* Update CHANGES.md

Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-10-31 23:49:15 +08:00
mrproliu 1d0d07ba96
Change toolkit plugin test to release version (#5762)
Co-authored-by: Mrproliu <mrproliu@lagou.com>
2020-10-31 21:33:13 +08:00
Jared Tan ac481e1bbb
update hystrix plugin version support list. (#5759) 2020-10-31 12:15:26 +08:00
mrproliu af41da0e93
Support choose files to activate the meter analyzer (#5748) 2020-10-29 23:46:07 +08:00
kezhenxu94 92bb474c2d
Improve Kubernetes service registry for ALS analysis (#5722)
The current implementation of envoy ALS K8S analysis is based on the hierarchy, pod -> StatefulSet -> deployment, StatefulSet, or others. It's freaky and different from the Istio Kubernetes registry.

The new path is pod -> endpoint -> service, and we should leverage Informer API instead of raw Kubernetes API.
2020-10-29 18:22:38 +08:00
Humbertzhang c95a913492
Add percentile tests in e2e test. (#5737) 2020-10-29 14:38:49 +08:00
Daming 0c4827d056
remove finagle-6.25.0-scenario (#5747) 2020-10-29 07:50:57 +08:00
zifeihan e1619495c3
Add feign loadbalancer case for spring-cloud-feign-1.x-scenario plugin. (#5711) 2020-10-22 14:03:28 +08:00
zifeihan 63d63ed7f5
Add feign loadbalancer case for spring-cloud-feign-2.x-scenario plugin. (#5700) 2020-10-21 07:58:09 +08:00
zhang-wei 7e6b19dfc0
Fix some bugs with browser (#5683)
* fix query browser error log  bug
2020-10-18 17:58:29 +08:00
Daming 98968122e9
Provide Thrift Plugin (#5644) 2020-10-16 16:09:47 +08:00
kezhenxu94 88aab349c3
Update pre.sh (#5677) 2020-10-16 12:36:11 +08:00
kezhenxu94 239eaa01fd
test: set up ALS E2E test (#5675) 2020-10-15 23:20:46 +08:00
mrproliu 494c146ed5
Provide meter agent test tool support (#5648) 2020-10-13 07:58:14 +08:00
Humbertzhang 39815388a3
Add E2E test for python Kafka report protocol (#5640) 2020-10-10 16:41:18 +08:00
xbkaishui c9b6a78ca9
Limit Sql body size (#5626) 2020-10-04 23:22:32 +08:00
吴晟 Wu Sheng 103cf00672
Support JDK 11 compiling and upgrade dependencies (#5579)
* Upgrade dependencies and make the JDK11 compiling passed.

* Update license and fix license check file.

* Add CI for JDK11 compiling.

* Update doc.
2020-09-29 10:34:21 +08:00
vcjmhg 806666b4cc
add webflux webclient plugin (#5493) 2020-09-27 22:38:07 +08:00
mrproliu a68be426a0
Provide metrics APIs for agent plugin (#5523) 2020-09-26 21:30:37 +08:00
zifeihan 84d49c4412
Add kafka config for how long does kafka query server topic will trigger timeout (#5554) 2020-09-25 13:03:51 +08:00
harvies fa62c637c2
remove minor version test tasks (#5544)
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-09-23 21:17:54 +08:00
harvies c33a55cda1
Test for mongo3.x support version (#5539) 2020-09-22 22:08:58 +08:00
harvies 1ff25ac4f4
Support mongo driver 4.x version. (#5512) 2020-09-22 17:09:24 +08:00
harvies c3edd3dad0
Better witness class for mongo3.8.x (#5524)
* modify witness class

* modify witness class & add test case

* replace DB_STATEMENT to DB_BIND_VARIABLES & remove executeMethod prefix

* fix ci

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-09-22 09:50:44 +08:00
hailin0 e200ef1045
Add support for xxl-job (#5519) 2020-09-20 10:04:32 +08:00
harvies 266414f261
update agent-test-tools version (#5522)
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-09-19 20:27:39 +08:00
Lu Jiajing c65bcf1142
Check bootstrapServers type before casting for kafka-clients >= 2.1 (#5510) 2020-09-18 15:18:54 +08:00
吴晟 Wu Sheng 224af7f625
Correct the module missing check in the ModuleManagerCore (#5484)
* Correct the module missing check.
* Don't check the docker compose version, as the GitHub installed 3.x in default.
2020-09-15 16:32:41 +08:00
Evan 29de696c42
exception-ignore-plugin (#5426) 2020-09-09 15:07:01 +08:00
Xin,Zhang 1b5dd9b3f3
Move spring webflux into optional plugin (#5445)
* Move spring webflux into optional plugin

* Fix compile check

* Fix check style

* Adjust code

* add docs

* Update docs/en/setup/service-agent/java-agent/README.md

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-09-09 09:53:07 +08:00
CoderGang c89e766f0d
Fix the bug #5443 and add documents for the local E2E remote debugging. (#5457)
* fix the E2E bug when running locally with multiple `docker-compose.yml` files #5443

* add documents for the for local remote debugging.

Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2020-09-09 00:26:11 +08:00
Evan 10fe6b2585
fix plugin test (#5456) 2020-09-08 16:45:48 +08:00
Brandon Fergerson f8c887e241
Include request method type in rest mapping annotations (#5085) 2020-09-05 23:14:40 +08:00
zhang-wei 7ef8b3e476
Support Browser protocol at OAP (#4228) 2020-08-31 15:46:37 +08:00
hailin0 ca957699dc
Add support for quartz-scheduler (#5413) 2020-08-30 23:48:26 +08:00
hailin0 afc0aef567
Add logic-endpoint and testcase for elasticjob-2.x plugin (#5395) 2020-08-28 14:27:07 +08:00
Daming 8bf38cc29c
using openjdk:14-buster as base image of PluginTest (#5404) 2020-08-28 09:07:03 +08:00
Xin,Zhang 77d94b4d2a
Fix issue that spring mvc plugin doesn't works when running on reactive api (#5360) 2020-08-26 13:22:39 +08:00
Daming 6c1659c56a
[plugin/test] Plugin test with jdk14 (#5352)
* plugin test with jdk14

* introduce jdk14 container

* remove docker:build

* remove BUILD_NO and introduct image_version

* Update docs/en/guides/Plugin-test.md

Co-authored-by: kezhenxu94 <kezhenxu94@163.com>

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
2020-08-24 20:17:22 +08:00
hailin0 1b54b61a88
Add support for spring @Scheduled (#5339) 2020-08-23 17:13:49 +08:00
Lu Jiajing 5bfac1b50f
Remove style-check exception for logger (#5363) 2020-08-21 18:26:25 +08:00
xbkaishui 79c1c0cc76
Support http header tag (#5348) 2020-08-20 10:43:28 +08:00
于玉桔 494d2a5b65
Elastic job plugin use wrong span type (#5347) 2020-08-19 21:21:09 +08:00
于玉桔 ed71efda52
Fix spring-kafka test unstable (#5313) 2020-08-17 11:43:04 +08:00
Daming b588b5f681
Fix spring-kafka test unstable (#5310)
* fix spring-kafka test unstable

* fix spring-kafka test unstable
2020-08-14 12:24:18 +08:00
于玉桔 ab5555fe27
Support @KafkaPollAndInvoke annotation to replace @Trace when just using the Kafka scenario agent plugin (#5304) 2020-08-13 21:18:04 +08:00
xbkaishui a7e77832a9
disable kafka property in agent.config (#5305)
* disable kafka plugin

* enable docker file of kafka for e2e test
2020-08-13 11:09:58 +08:00
于玉桔 e37fc2e439
Support spring-kafka (#5254) 2020-08-10 19:13:19 +08:00
于玉桔 69297b9ec6
Support Apache ShardingSphere-Elasticjob (#5153) 2020-08-10 10:48:23 +08:00
yangy 9b6a4ed28c
Fix kafka plugin sometimes trace doesn't show span layer (#5264) 2020-08-08 14:39:54 +08:00
CoderGang 4b441f06c3
Support for the remote debugging of local E2E testing framework (#5198) 2020-08-07 21:19:10 +08:00
kezhenxu94 58854a9bd8
Update commit hash in Python E2E test to v0.2.0 (#5256) 2020-08-07 10:28:54 +08:00
于玉桔 446d7100f9
fix type (#5255)
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-08-07 09:37:36 +08:00
于玉桔 d4e64584af
fix version forgot update (#5226) 2020-08-07 07:48:22 +08:00
zshit dd6f439df1
support collecting feign params (#5235) 2020-08-06 13:09:31 +08:00
于玉桔 7a20c260bb
Add HBase hbase-client plugin (#5225) 2020-08-05 17:55:20 +08:00
吴晟 Wu Sheng 48311e095a
Use client side component name when no server side mapping. (#5232)
* Use client side component name when no server side mapping.

* Unknown component should be fixed, so change the e2e expected data.
2020-08-05 13:34:58 +08:00
于玉桔 4149ac59fe
The Dubbo plugin can collect more information by custom (#5209) 2020-08-04 23:26:56 +08:00
Daming f9257f5274
Provide kafka as collector/reporter (#4847) 2020-07-30 11:55:49 +08:00
李文广 3a00d84766
spring-annotation plugin add component (#5160) 2020-07-25 23:14:46 +08:00
mrproliu 925c0d74c7
Provide server-side meter (#4972) 2020-07-25 21:17:32 +08:00
Stalary 1877d0fcf4
Add jvm_thread metrics (#5129) 2020-07-22 09:05:32 +08:00
Patrick Jiang(白泽) 62f76881de
Fix issue 4965 (#5109) 2020-07-17 17:36:02 +08:00
Brandon Fergerson c8fc457e82
Better Vert.x endpoint names (#5064) 2020-07-09 23:32:43 +08:00
kezhenxu94 32202e053a
BugFix: x-le tag format in GraphQL plugin (#5054) 2020-07-08 12:59:55 +08:00
caoyixiong 80a534b1bb
support Graphql Logic endpoint (#5030) 2020-07-05 23:37:09 +08:00
gongdewei 1817386391
Support cache mode in the agent. (#4858) 2020-07-01 23:20:50 +08:00
kezhenxu94 54a43c4cef
Update Python commit hash to v0.1.0 (#4988) 2020-06-30 07:23:43 +08:00
caoyixiong 31f42343f6
add brpc-java plugin (#4958) 2020-06-27 14:57:29 +08:00
Gao Hongtao e143ae62eb
Reduce the length of metric name (#4936) 2020-06-22 09:10:51 +08:00
dagmom 08897ce5f8
New feature provided : new plugin for influxdb-java client (#4846) 2020-06-21 22:35:45 +08:00
dagmom 8648f0d417
update the commit id in the main repo to update the tool in CI process. (#4956) 2020-06-21 21:08:33 +08:00
于玉桔 c778a0d6c2
Support Quasar fiber tracing (#4951) 2020-06-20 22:30:03 +08:00
zhang-wei 38759318bd
update Dockerfile.go (#4944) 2020-06-18 14:04:28 +08:00
吴晟 Wu Sheng cf80986e71
Update Dockerfile.nginx (#4930) 2020-06-16 10:25:55 +08:00
xiaoyu 164124fc22
provider shardingSphere 4.0.0 4.0.1 plugin. (#4927) 2020-06-15 17:03:17 +08:00
xiaoyu a24efcf5e9
ShardingSphere plugins conflict among themselves. (#4921)
* Fix shardingSphere plugin test fail if have some same ENHANCE_CLASS define.

* support 4.1.0 and 4.1.1

* support 4.1.0 and 4.1.1
2020-06-14 18:48:07 +08:00
Xin,Zhang 7b99019c49
Refactory spring gateway plugin (#4878) 2020-06-12 00:25:41 +08:00
denis e2b04b58b1
fix Kafka consumer subscribe topics from pattern (#4873) 2020-06-11 17:55:04 +08:00
xiaoyu 9a9401fdb6
provide shardingSphere(4.0.0,4.0.1, 4.1.0 ,4.1.1) plugin. (#4894) 2020-06-11 14:49:04 +08:00
何延龙 305a6b3032
[PHP-E2E] Support v8 (#4862) 2020-06-05 18:02:44 +08:00
Daming 3f176bf50f
[hotfix]Fix UITemplate storage Influxdb implamented (#4849) 2020-06-02 16:05:21 +08:00
吴晟 Wu Sheng d094a0f7c0
Support UI template management. (#4843) 2020-06-01 23:06:14 +08:00
Brandon Fergerson 705f97f27a
Increased Vert.x support (#4840) 2020-06-01 21:00:16 +08:00
zifeihan e8e9153d74
fix ClassCastException in KafkaProducerInterceptor (#4826) 2020-05-31 08:12:02 +08:00
Brandon Fergerson 594fb15b53
Increased support for Vertx (#4827) 2020-05-26 22:02:34 +08:00
kezhenxu94 edd8305fa2
Check http protocol in Python agent as well (#4805) 2020-05-23 16:05:13 +08:00
lipenghui a12ecea449
Add more pulsar test versions. (#4814) 2020-05-22 22:33:44 +08:00
吴晟 Wu Sheng 39adda09f3
Make the default application.yml more friendly in the configuration s… (#4777)
* Make the default application.yml more friendly in the configuration section.

* Fix an issue in python e2e.
2020-05-12 16:55:31 +08:00
kezhenxu94 576bd7e286
Test: add E2E test for Python Agent (#4770) 2020-05-11 16:05:06 +08:00
mrproliu 816878897c
Support multiple ways to analyze segments in rest (#4745)
* support multiple segments analyze

* Support multiple ways to analyze segment data

* Change to support single or list of the segment data, add the document

* fix document and change the lua agent commit id

Co-authored-by: Mrproliu <mrproliu@lagou.com>
2020-05-08 22:54:36 +08:00
Efe Kaptan d19ba41678
Mariadb JDBC plugin (#4740)
* Add Mariadb JDBC plugin and provide tests

* Refactor component name

* Reformat plugin description and remove healthcheck span from the test

Co-authored-by: Efe Kaptan <Efe.Kaptan@webtrekk.com>
Co-authored-by: zhang-wei <pknfe@outlook.com>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-05-07 20:54:30 +08:00
Brandon Fergerson 4fc57a6663
Increase Vert.x Compatability (#4736)
* vertx web plugin re-impl attempt

* added license

* update test for new plugin structure

* got rid of registryItems

* remove unnecessary dependencies

* re-impl eventbus scenario

* more precise naming

* fix expected data

* removed unsupported versions and removed vertx caching (avoids permission error)

* rewrote to remove copied code

* Update plugins-test.3.yaml

* fixes issue of .vertx files remaining on v3.0.0

* only present in v3.0.0

* consistency

* add more supported versions

* track status code

* spelling fix

* track status code

* more correct naming

* reverts 213f5a69 (status code isn't sent at this point)

* made HttpServerResponseImplEndInstrumentation more strict based on version
added status code tracking
fixes issue not finishing async spans

* works 3.0.0,3.7.0

* increase compatibility

* 3.9.0 default

* versioned witness classes (advice from wu-sheng)

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: zhang-wei <pknfe@outlook.com>
2020-05-01 17:06:46 +08:00
Jared Tan d51c788113
support user to customize an endpoint (#4716)
* support user to customize an endpoint with toolkit.

* fix code style.

* add md.

* Update docs/en/setup/service-agent/java-agent/Application-toolkit-trace.md

Co-Authored-By: 吴晟 Wu Sheng <wu.sheng@foxmail.com>

* add test case.

* fix expecteddata.tml.

* fix data.

* fix expecteddata.tml.

* remove operationId in expectedData.yaml.

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-04-29 19:39:52 +08:00
Daming e8be63465c
More strict PluginTests expected data verifier (#4713)
* More strict PluginTests expected data verifier

* remove unnecessary file

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-04-25 23:35:47 +08:00
Brandon Fergerson 776d508018
Vertx plugin test re-implementation (#4624)
* vertx web plugin re-impl attempt
2020-04-24 19:49:03 +08:00
Daming 44f1b4a4ff
[test/plugin] Enhance PluginTest (#4677)
1. Re-balance the workload of plugintests
2. Restore testcases of MySQL, remove on #4641
3. Support user to runs plugin-test on debug mode. It will not remove the log files and actualData.yaml
4. remove paramater 'parallel_run_size' and disable parallel test.
2020-04-22 20:43:17 +08:00
mrproliu 4e821415ea
Fix profile recheck error (#4690) 2020-04-22 19:25:56 +08:00
mrproliu 7d1fdd3ea8
Support v3 extension header (#4666)
* support v3 extension header

Co-authored-by: Mrproliu <mrproliu@lagou.com>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-04-21 17:09:02 +08:00
kezhenxu94 8e6a527f78
Add Java versions 9~14 to E2E tests (#4674) 2020-04-21 13:45:32 +08:00
Daming 28530cd79d
Upgrade the InfluxDB storage-plugin to protocol V3 (#4641)
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2020-04-19 20:10:59 +08:00
kezhenxu94 21bb638d50
[Test] Remove all images after E2E tests and disable ES threshold (#4671) 2020-04-19 16:54:16 +08:00
kezhenxu94 c11ad038cc
Count the coverage in E2E tests and Plugin tests (#4651) 2020-04-15 23:09:05 +08:00
zhang-wei ccb65ff27f
Add `java` -> `go2sky` -> `java` e2e test case, and adapt v3 protocol (#4647)
* go2sky e2e

Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2020-04-15 10:01:11 +08:00
mrproliu 171620bfa8
Add Nginx correlation e2e test (#4646) 2020-04-14 09:32:54 +08:00
kezhenxu94 00e8f2d886
Fix bug that the agent heart beats too frequently (#4640)
* Fix bug that the agent heart beats too frequently

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-04-12 20:48:44 +08:00
mrproliu 1601cc107c
Support `java` -> `nginx` -> `java` e2e test, and v3 protocol (#4637) 2020-04-11 22:31:28 +08:00
吴晟 Wu Sheng 6fe2041b47
Make 8.0.0 Core available. New protocol and register removed. (#4599)
Here are the list of changes we made in this pull request. Top 3 are the principle changes, others are following these principles.
1. New agent and mesh report protocol. 
2. New agent header protocol. 
3. Service register, instance register and network address register have been removed permanently.
4. Service traffic, instance traffic and network alias metrics are added to replace the service, instance and network address inventory.
5. Register process has been removed.
6. Metrics stream process supports insert only mode, especially for traffic entities.
7. Metrics stream process supports no-downsampling mode for traffic entities and network alias.
8. Remove all register mechanism and cache in the java agent.
9. Remove MONTH step in GraphQL query.
10. Update UI to remove MONTH step query, the max query range is 60 days now.
11. Simplify the TTL to metrics and record. And the unit has been formatted in Day unit. No specific TTL for ElasticSearch storage.
12. Buffer mechanism of trace receiver and mesh receiver has been removed due to no register.
13. New service id, instance id and endpoint id rules, including service relation, instance relation and endpoint relation id rules.
14. Java agent support `keep tracing` mode, meaning, agent generating tracing context even the backend is unconnected/unavailable.
15. Plugin test tool up to date, in order to support new protocol.
16. Plugin tests expected data files updated.
17. E2E tests updated.
18. Telemetry of Grafana config has been merged into one.
19. Documentation updates.
20. [TBD] InfluxDB storage implementation is not available, need @dmsolr to fix later, in order to reduce the master change block by this PR.
2020-04-10 11:03:24 +08:00
吴晟 Wu Sheng 4474907fef
[Inventory Design Change] Remove endpoint register and endpoint inventory (#4570)
* Finish step one, source and entity changed.

* Step 2, finish the basic and core DAO changes.

* Step 3. Change all source codes of backend, and make project compiling successfully.

* Make startup successful and persistence works.

* Fix dead codes in the MySQLTableInstaller.

* Fix mischange.

* Fix MySQL storage bootstrap error.

* Rollback dependency change.

* Simply enable tailing logs from container no mater it's in CI or not

* Fix segment table issue.

* Fix MySQL Instanller.

* Support Influxdb implementation of new endpoint traffic.

* Set and modify timeout to 90mins

* Remove unnecessary entity in the EndpointTraffic.

* Fix wrong entity builder and make name more clear.

* Fix 2 equal methods bug.

* Fix InfluxDB identifier(name) conflict issue.

* Fix endpoint topology query, endpoint id should be changed as a string.

* Fix a missing change.

* Fix a wrong commit.

* Column name can't be changed, due to it affect the hybrid metadb(h2/mysql) query, change it explicitly with double quotation marks.

* Fix formats.

* Remove endpoint/operation register from the agent. and change the plugin tests(without local tests). operationId relation codes have been removed from agent too.

* Try to fix the hytrix case.

* Fix 3 cases.

* Try to fix cases.

* Fix 2.

* Fix one.

* Fix the serviceId type mis-change.

* Fix int query

* Fix hystrix case.

* Fix a case.

* Fix EndpointCallRelationDispatcher set the source/dest endpoint without id encoding.

* Update documentation and add 2 test cases.

Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
2020-03-28 22:51:41 +08:00
何延龙 4eb3df4065
Fix E2E-PHP bugs (#4584) 2020-03-28 14:39:33 +08:00
何延龙 9c62e4f52d
Add 200000 microsecond sleep in E2E-PHP (#4582)
* fix #4539, add PHP to the query protocol

* Add PHP module support to e2e test

* Add PHP e2e test into the CI control file

* Remove networks aliases

* Add PHP module support to e2e test

* Add e2e.php.yaml

* Locked version

* Add 200000 microsecond sleep in E2E-PHP

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2020-03-28 09:13:38 +08:00
yi.liang 1bc4082821
fix elasticsearch-5.x-plugin when use es6.x TransportClient error (#4517)
* up ui

* up ui

* fix elasticsearch-5.x-plugin on es6.x TransportClient error, Found class org.elasticsearch.common.transport.TransportAddress, but interface was expected
up elasticsearch-6.x-plugin support TransportClient

* fix elasticsearch-5.x-plugin on es6.x TransportClient error, Found class org.elasticsearch.common.transport.TransportAddress, but interface was expected
up elasticsearch-6.x-plugin support TransportClient

* fix elasticsearch-5.x-plugin on es6.x TransportClient error, Found class org.elasticsearch.common.transport.TransportAddress, but interface was expected
up elasticsearch-6.x-plugin support TransportClient

* const string witnesses
add some unit test
recommended to change ; to ,

* const string witnesses
add some unit test
recommended to change ; to ,

* up ES6.X test-plugin

* up es6.x test-plugin

* up es6.x test-plugin

* up es6.x test-plugin

* add DeleteIndexRequest

* up es6.x test-plugin

* remove TransportCaseController.java

* fix TransportActionNodeProxyExecuteMethodsInterceptorTest

Co-authored-by: yi.liang <yi.liang@zhangmen.cn>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: 梁懿 <liangyi@xforceplus.com>
Co-authored-by: aderm <394102339@qq.com>
2020-03-27 13:50:27 +08:00
mrproliu 569baf3236
Correlation protocol implement (#4555)
Co-authored-by: Mrproliu <mrproliu@lagou.com>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2020-03-26 09:02:14 +08:00
kezhenxu94 72f46f7499
Add missing `@Repeatable` to `@Tag` annotation (#4567)
* Add missing `@Repeatable` to `@Tag` annotation

* Remove some verified minor versions to speed up plugin tests
2020-03-25 09:58:16 +08:00
何延龙 954eede0ec
Add PHP module support to e2e test (#4547) 2020-03-23 23:16:28 +08:00
kezhenxu94 f51ba3a94d
[Chore] Fix license headers and rename E2E job name (#4551)
* Fix license headers and rename E2E job name

* Fix RAT plugin and enable both RAT and checkstyle plugin
2020-03-23 13:51:39 +08:00
mrproliu ace781ff49
Provide HTTP parameter in the profiling contet (#4546)
* Provide active HTTP parameter collection automatically in the profiling context

* Fix style check

* fix style error

* Add profile status, storage it into TracingContext. simplify to get profiling method

* Change the profile status field name in TracingContext

* Replace gone images

* resolve issues

* resole description issues

Co-authored-by: Mrproliu <mrproliu@lagou.com>
Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
2020-03-22 17:19:57 +08:00
mrproliu a9d34e3b61
Remove unnecessary parameter in the profile log query (#4549)
* Remove unnecessary parameter in the profile log query

* Replace gone images

Co-authored-by: Mrproliu <mrproliu@lagou.com>
Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
2020-03-22 12:49:43 +08:00
cngdkxw 2e9f001633
Add spring cloud feign 2.x plugin (#4526) 2020-03-20 20:28:30 +08:00
kezhenxu94 dcd66ee6e9
Rewrite the E2E test framework and tests (#4510)
Motivation:

According the feedback from the community, the e2e tests are hard for
them to understand and get them started, so this pull request aims to
rewrite the e2e tests with some improvements:

- debuggable locally, now you can run every individual case directly
inside the IDE, just like running a plain unit test.

- same functionalities of multiple counterparts share the same codes,
cases like different storages and cluster coordinators share the same
codes, easy to add more similar cases.

- the "end" now extends to the Doccker images, meaning that some bugs
like #4483 and #4471 can be more easily and early to be discovered.

- codes style and license headers are checked

Modifications:

- adopt jupeter (a.k.a junit 5), testcontainers as the new test
framework, all containers are orchestrated by docker-compose.yml,
well-known technology that developers should be familiar with.

- rewrite all test cases and verify them.

- reorganize the workflows in GitHub Actions.

Result:

- new e2e test should be easy to add.

- closes https://github.com/apache/skywalking/issues/4472
2020-03-16 23:45:14 +08:00
kezhenxu94 69e3d80e24
Add selector property in application.yml (#4514)
### Motivation

 Ease the efforts of modifying configurations in automatic workflow and scripts, like Docker and helm chart.

 ### Modification

 Add a `selector` property into `application.yml` to enable switching configuration simply by environment variables or system properties, and filter the unselected options, leaving only selected one.

 ### Result

 - We can switch a configuration by environment variables or system property

 - Closes #4511
2020-03-15 23:28:14 +08:00
Gao Hongtao 78d14ebbd6
Enable OAP gRPC SSL transportation (#4470)
* Enable OAP gRPC SSL transportation

Porting to OpenSSL to enable SSL transportation. The server private
key is in the format of PCKS#8, certificates is x509 though.

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Add netty-tcnative-boringssl-static 2.0.26 licnese

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Update docs/en/setup/backend/grpc-ssl.md

Co-Authored-By: kezhenxu94 <kezhenxu94@apache.org>

* Update docs/en/setup/backend/grpc-ssl.md

Co-Authored-By: kezhenxu94 <kezhenxu94@apache.org>

* Add SSL to grpc remote client and sharing server

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Update documents

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Fix nits

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Fix test case

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Add e2e-ssl and remove other test cases temporarily

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Add TLS relevant files

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Decrease timeout

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Test config works

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* triger CI on oap-ssl branch

* Disable agent ca

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Switch to sharing server

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Add agent log to console

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Upload log files

* Change backend

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Revert "Change backend"

This reverts commit 7a085711e3653d3bf642aa84f73650e22595e383.

* Update backend

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Revert e2e

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Ignore TSL relevant files

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Polish codes

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Update certificates expires year to 2120

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2020-03-15 08:15:28 +08:00
cngdkxw d5efc97c80
RestTemplate async plugin ClassCastException (#4507)
* ClassCastException

* resttemplate 4.x scenario

* add support versions & fix expectedData format-

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-03-13 23:13:51 +08:00
Gao Hongtao fdb816c799
Update MiniKube for CI process (#4495)
* Update pre.sh

* add if func

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Reorder steps

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Upgrade minikube to 1.8.0

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-03-12 10:33:11 +08:00
yoje ced5cb2828
Add finagle plugin (#4441)
* Add finagle plugin (#4433)

* fix failed checks for pr(#4441)
* Add licenses for some files
* Update Supported doc
* Add finagle to test component-libraries.yml

* Add finagle automatic tests into CI

* Add comments

* update comments

* Remove CompatibilityChecker

* Move query-protocol submodule to the right version

* Remove `enhancedInstance.setSkyWalkingDynamicField` in `ClientTracingFilterInterceptor`.

* Update expectedData.yaml of finagle tests

* Use lazy ContextCarrier injection.

* Add comments for `ContextCarrierHelper`

* Fix ContextHolderFactory to avoid context pollution

Co-authored-by: huangyongjie <huangyongjie@tigerbrokers>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-03-11 13:04:58 +08:00
Daming da44d28547
Introduce Agent-Test-Tool suite (#4458)
* Introduce Agent-Test-Tool suite

* rename term
2020-03-08 09:15:41 +08:00
吴晟 Wu Sheng 9b8a8be27e
Update pom.xml (#4452)
Update the latest release commit to the e2e for release verification.
2020-03-06 22:37:08 +08:00
Jared Tan aa21765628
support http api for upstream trace. (#4399)
* support http api.

* e2e

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2020-03-06 21:07:39 +08:00
mrproliu 0df2d0a5e9
Provide profile exporter tool (#4416) 2020-03-04 20:28:14 +08:00
Jared Tan 85cc9c36ac
fix agent auth e2e not activated. (#4428)
* fix e2e miss.
2020-02-29 22:20:43 +08:00