Commit Graph

59 Commits

Author SHA1 Message Date
kezhenxu94 69e3d80e24
Add selector property in application.yml (#4514)
### Motivation

 Ease the efforts of modifying configurations in automatic workflow and scripts, like Docker and helm chart.

 ### Modification

 Add a `selector` property into `application.yml` to enable switching configuration simply by environment variables or system properties, and filter the unselected options, leaving only selected one.

 ### Result

 - We can switch a configuration by environment variables or system property

 - Closes #4511
2020-03-15 23:28:14 +08:00
Gao Hongtao 78d14ebbd6
Enable OAP gRPC SSL transportation (#4470)
* Enable OAP gRPC SSL transportation

Porting to OpenSSL to enable SSL transportation. The server private
key is in the format of PCKS#8, certificates is x509 though.

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Add netty-tcnative-boringssl-static 2.0.26 licnese

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Update docs/en/setup/backend/grpc-ssl.md

Co-Authored-By: kezhenxu94 <kezhenxu94@apache.org>

* Update docs/en/setup/backend/grpc-ssl.md

Co-Authored-By: kezhenxu94 <kezhenxu94@apache.org>

* Add SSL to grpc remote client and sharing server

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Update documents

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Fix nits

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Fix test case

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Add e2e-ssl and remove other test cases temporarily

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Add TLS relevant files

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Decrease timeout

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Test config works

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* triger CI on oap-ssl branch

* Disable agent ca

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Switch to sharing server

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Add agent log to console

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Upload log files

* Change backend

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Revert "Change backend"

This reverts commit 7a085711e3653d3bf642aa84f73650e22595e383.

* Update backend

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Revert e2e

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Ignore TSL relevant files

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Polish codes

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Update certificates expires year to 2120

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2020-03-15 08:15:28 +08:00
cngdkxw d5efc97c80
RestTemplate async plugin ClassCastException (#4507)
* ClassCastException

* resttemplate 4.x scenario

* add support versions & fix expectedData format-

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-03-13 23:13:51 +08:00
Gao Hongtao fdb816c799
Update MiniKube for CI process (#4495)
* Update pre.sh

* add if func

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Reorder steps

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Upgrade minikube to 1.8.0

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-03-12 10:33:11 +08:00
yoje ced5cb2828
Add finagle plugin (#4441)
* Add finagle plugin (#4433)

* fix failed checks for pr(#4441)
* Add licenses for some files
* Update Supported doc
* Add finagle to test component-libraries.yml

* Add finagle automatic tests into CI

* Add comments

* update comments

* Remove CompatibilityChecker

* Move query-protocol submodule to the right version

* Remove `enhancedInstance.setSkyWalkingDynamicField` in `ClientTracingFilterInterceptor`.

* Update expectedData.yaml of finagle tests

* Use lazy ContextCarrier injection.

* Add comments for `ContextCarrierHelper`

* Fix ContextHolderFactory to avoid context pollution

Co-authored-by: huangyongjie <huangyongjie@tigerbrokers>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-03-11 13:04:58 +08:00
Jared Tan aa21765628
support http api for upstream trace. (#4399)
* support http api.

* e2e

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2020-03-06 21:07:39 +08:00
Jared Tan 85cc9c36ac
fix agent auth e2e not activated. (#4428)
* fix e2e miss.
2020-02-29 22:20:43 +08:00
aderm 467ef8bffc
Update to actions/checkout@v2, fix checks error: reference is not a tree. (#4419) 2020-02-27 22:31:58 +08:00
zhang-wei 2ac2d2555a
[test/plugin] immigrate h2 & struts scenario (#4395)
* immigrate test code

* enhance mysql case healthCheck

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-02-23 20:34:44 +08:00
Daming 29da5738bc
Provide influxdb as a new storage plugin (#4239)
* provide influxdb as a new storage plugin

Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-02-19 18:00:57 +08:00
aderm 8c96fd49dd Update elasticsearch-7.x agent support version. (#4340)
* test/plugin/scenarios/elasticsearch-7.x-scenario/support-version.list

* update elasticsearch-7.x agent support version.

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-02-10 19:10:38 +08:00
kezhenxu94 408a777d9d
Make traces verification loosely (#4306)
### Motivation:

Make E2E tests more stable.

### Modifications:

Verify the traces loosely as other tests, and remove the `verify` method which verifies traces strictly, as we have preparation that also generates traces.

### Result:

E2E tests are more stable.
2020-02-02 14:11:47 +08:00
Daming 9005d1e82c
Provide AVRO plugin (#4276)
* Provide Avro plugin
* provide testcase for avro-plugin

Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
2020-01-30 17:49:43 +08:00
mrproliu 8e4c1e95d6 Merge e2e profile test project (#4268)
* merge e2e profile test project, Use `env` to distinguish different storage types

* remove maven child module

* change `env` -> `storage`

Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
2020-01-20 19:34:53 +08:00
吴晟 Wu Sheng 9149de2a6e Support multiple linear values and merging p50/75/90/95/99 into percentile (#4214)
* Support new percentile func with new alarm and exporter for this new func.

* Fix e2e and OAL script

* Fix wrong column.

* Fix percentile bug and oal engine bug.

* Update query protocol and add percentile test case

* Support new query

* Adopt GraphQL requirement

* Fix wrong type cast.

* Fix query in H2 and ES.

* Fix docs and comments.

* Fix an e2e compile issue

* Fix javadoc issue and e2e test issue.

* Change CPM to Apdex in TTL test.

* Fix OAL for TTL e2e

* Add metrics query for service percentile.

* Fix OAL engine bug. Method deserialize is not working when more than two field types are IntKeyLongValueHashMap

* Support multiple IntKeyLongValueHashMap fields in remote. About serialize/deserialize methods.

* Fix graphql statement error in e2e.

* Fix serialize not working and add generated serialize/deserialize of percentile into test cases.

* Fix test case format

* Remove generated code test.

* Fix failed e2e test

* Use avg resp time to apdex in the TTL test.

* ADD multiple linear metrics check for endpoint in e2e cluster.

* Support `-` to represent no threshold and doc of alarm about this.

* Move break to right place.

* Fix wrong break(s)

* Fix break and add a test case for multiple values alarm.

* Fix format.

* Add more doc for this new feature and GraphQL query protocol.

Co-authored-by: Jared Tan <jian.tan@daocloud.io>
Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
2020-01-12 22:10:50 +08:00
dengliming 1881a040d4 Support plugin for mongodb v3.6.x (#4173)
* feat: add support plugin of mongodb v3.6.x

* update support-version.list

* update Supported-list.md

* update Supported-list.md

* Add witness class for v3.6

* update plugins-test.yaml

Co-authored-by: zhang-wei <pknfe@outlook.com>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: Weiyi Liu <liuweiyi@cmss.chinamobile.com>
2020-01-07 14:25:19 +08:00
Gao Hongtao 8d0c3b912f Add es7 support to docker (#4043)
* Add es7 support to docker

* Add es7 to github aciton workflow

* Rename dockerfile

* Update docker-compose

* Update matrix es name

* Set oap tag

* Add document

* Update How-to-build.md
2020-01-05 17:08:14 +08:00
Kanro 4e03d5e6d7 Add kotlin coroutine plugin (#4165)
* Kotlin coroutine plugin write in Java

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-01-04 22:51:59 +08:00
aderm 6be84cfa78 update elasticsearch-7.x agent support version. (#4171)
* update elasticsearch-7.x agent support version.

* update supported-list.md doc & plugins-test.yaml
2020-01-04 19:56:35 +08:00
mrproliu d38a8eaaa7 Provide thread monitor create task feature (#4145)
* provide thread monitor task service to create

* provide thread monitor task GraphQL implements

* 1. change thread monitor field names
2. fix `getThreadMonitorTaskList` query time bucket error

* provide config stream processor

* update submodule `query-protocol`

* resolve e2e-mysql error

* remove useless storage interface method.

* rename `ThreadMonitorTask` to `ProfileTask`

* change e2e-profile to the top level

* fix profile test analyze error

* remove StringUtil#isBlank.

* 1. remove create profile task duration unit
2. remove GraphQL getTask list duration field
3. add `profileTaskQueryMaxSize` in `storage` -> `elasticsearch(7)` configuration, default get 200 profile task

* provide e2e different storage tests

* 1. fix rat check
2. remove DurationUtils.java#toSecond
3. remove ProfileTaskQueryEs7DAO

* fix e2e code format error

* provide es6 and es7 storage e2e tests

* change e2e profile es module artifactId

Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
2019-12-31 20:49:45 +08:00
Zhang Yonglun c5827f889a [Agent] Provide plugin for ShardingSphere 4.0.0-RC3 (#4140)
* shardingsphere 4.x RC3 test

* shardingsphere 4.x RC3 test

* shardingsphere 4.x RC3 test

* shardingsphere 4.x RC3 plugin

* shardingsphere 4.x RC3 plugin

* shardingsphere 4.x RC3 plugin

* shardingsphere 4.x RC3 plugin temp for a test

* shardingsphere 4.x RC3 plugin revert temp changes

* shardingsphere 4.x RC3 plugin change package name

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2019-12-31 17:52:29 +08:00
aderm f64f3c1433 [test/plugin] immigrate test activemq scenario. (#4151)
* [test/plugin] immigrate test activemq scenario.

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2019-12-31 15:31:39 +08:00
Andy Ai 4aac3293ca [test/plugin] immigrate test play framework scenario (#4128)
* Add play-scenario

* Set play plugin as default

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: Weiyi Liu <liuweiyi@cmss.chinamobile.com>
2019-12-26 22:42:56 +08:00
kezhenxu94 ea9acc5c24
Add E2E test case to verify compatibility between 6.x agents and 7.x … (#4132) 2019-12-26 15:26:08 +08:00
Zhang Yonglun ab39cecb17 shardingsphere 4.x RC1 RC2 test (#4118) 2019-12-26 08:31:10 +08:00
于玉桔 1e9f929f97 [test/plugin] immigrate test zookeeper scenario. (#4106)
* zookeeper test

* update expected data file

* fix review code

* fixed

* bugfix

* update version

* fix bug

* fix

Co-authored-by: zhang-wei <pknfe@outlook.com>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2019-12-25 17:25:09 +08:00
于玉桔 7dc8065267 [test/plugin] immigrate test lettuce scenario. (#4113)
* lettuce test

* fix

* update version

*  a new one group

* revert

* update expect data

Co-authored-by: Weiyi Liu <liuweiyi@cmss.chinamobile.com>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2019-12-25 11:22:15 +08:00
zhang-wei ba192a9f13 [test/plugin] immigrate test servicecomb scenario (#4109)
* servicecomb scenario
2019-12-25 09:43:57 +08:00
kezhenxu94 bf6491f449
[Feature] Provide Java Agent for Apache HttpClient 3.x (#4111)
* Add Java Agent for Apache HttpClient 3.x

* Update Supported-list.md

* Update pom.xml
2019-12-24 23:20:44 +08:00
Zhang Yonglun 6fce5ca790 [test/plugin] immigrate test shardingsphere 3.x scenario. (#4093)
* shardingsphere 3.x test

* shardingsphere 3.x test refine

* shardingsphere 3.x test refine

* shardingsphere 3.x test refine

* shardingsphere 3.x test refine

* shardingsphere 3.x test refine

* shardingsphere 3.x test refine

* shardingsphere 3.x test refine

* Remove the local/exit span register mechanism

* for comments

* for comments
2019-12-21 11:59:33 +08:00
cyejing bc77fda5c1 Enhance webflux plugin, related to Spring Gateway plugin too. (#3945)
* webflux-reactive

* add support version comment, modify gateway

* add test case, modify name

* add docs

* remove healthCheck
2019-12-17 08:58:57 +08:00
kezhenxu94 3f48790c36 [Feature] Add Java agent plugin for Jdk Threading classes (#4067)
* Add Java agent plugin for Jdk Threading

* Fix expected data according to changes in master

* Update agent.config

* Fix failed plugin test
2019-12-17 00:12:14 +08:00
吴晟 Wu Sheng fd24a29b3b
Move e2e and istio e2e to master and release recheck. (#4048)
* Move e2e and istio e2e to master recheck.

* Try to run tests on tag(release)

* Add `v*` tag to trigger test only, as this is the release tag.

* Trigger CI again
2019-12-13 09:31:21 +08:00
吴晟 Wu Sheng a95627a0d8 Set up project builds on Windows and MacOS. (#4045)
* Set up project build on Windows and MacOS.

* Fix whitespace

* Fix missing phrases.

* Change command for windows.

* Fix typo.

* 1. Remove new local m2 repository
2. Remove CI-with-IT on Windows and MacOS due to no Docker service existing
3. Change mvnw to mvn on Windows.

* Remove cache.

* Merge into one command
2019-12-13 00:10:10 +08:00
aderm 4ec2cb07ed [test/plugin] immigrate test cassandra scenario. (#4040)
* [test/plugin] immigrate test cassandra scenario.

* update support list doc.

* delete space error.

* disable jmx report.

* remove jmx dependence.

* Disable jmx report.

* Update support list doc.
2019-12-12 12:52:00 +08:00
kezhenxu94 eea5d027cc
Add Armeria Java agent plugin (#4024) 2019-12-11 15:57:45 +08:00
zhang-wei e139e16366 [test/plugin] immigrate jdk http scenario (#4035)
* jdk-http

* jdk-http-scenario

* action
2019-12-10 13:22:31 +08:00
zhang-wei 3741f4e386 [Feature] Service instance dependency (#3978)
* dispatcher

* getServiceInstanceTopology implementation

* CacheUpdateTimer

* fix compilation failure

* fix compilation failure

* fix esDao

* Update dao list

* dispatcher

* getServiceInstanceTopology implementation

* CacheUpdateTimer

* fix compilation failure

* fix compilation failure

* fix esDao

* Update dao list

* test e2e

* add official_analysis.oal & update getServiceInstanceTopology

* test instance topo for single service

* fix gql

* fix verifyServiceInstances

* verifyServiceInstanceTopo

* fix verifyServiceInstanceTopo

* fix ServiceInstanceInventory#name

* fix ServiceInstanceInventory#name

* e2e test

* fix action

* fix provider port

* fix Instance Node Type

* re run

* fix expected-data

* add e2e mysql

* set @Test timeout

* fix ci

* increase timeout

* re check

* test ttl es7

* test ttl

* fix action

* merge group

* test ttl es7

* replace official_analysis.oal

* replace official_analysis.oal

* comments

* add TODO

* add TODO

* fix filed name
2019-12-09 08:23:21 +08:00
aderm 0b4afc17b8 update es7.x plugin test support version. (#4011)
* update es7.x plugin test support version.

* update Supported-list.md and action config.
2019-12-06 10:53:34 +08:00
aderm 17da2e2eec [test/plugin] immigrate test oracle scenario. (#4006)
* [test/plugin] immigrate test oracle scenario.

* repair ojdbc14.jar download url.

* 1.update ojdbc14.jar site;2.Adjust task position.

* fix curl download problem by add -L.

* Merge run steps.
2019-12-05 22:47:14 +08:00
lipenghui 821c50d0e4 [test/plugin]immigrate pulsar scenario (#3997)
* Apache Pulsar Immigration.

* Add apache license header and move pulsar scenario to Feign_Canal
2019-12-04 12:08:25 +08:00
innerpeacez 3e22ff5ece Add OAP+Istio(mixer) to CI pipeline (#3904) 2019-12-03 17:44:26 +08:00
Alan Lau 52de0c6dfa Immigrate test gson scenario. (#3989)
* Immigrate test gson scenario.

* Fix actions yaml & move gson test to other groups.

* Fix wrong format.

* Rename the group name.

* Add 2.8.6 version. && remove healthCheck.
2019-12-02 15:28:16 +08:00
Alan Lau c0c898cf6c Immigrate test mysql scenario. (#3948)
* Add mysql scenario
2019-11-30 21:22:50 +08:00
kezhenxu94 bdc0609296
Bring coverage and comment back (#3972) 2019-11-30 11:20:11 +08:00
Daming 244ec55fed skip unnecessary action (#3973)
* skip unnecessary action

* revert ci & e2e

* update
2019-11-29 18:01:51 +08:00
Daming 125e96e78c Set up CI-IT action and Split Plugin-Tests (#3956)
* set up CI-IT action and Split Plugin-Tests

* update
2019-11-29 07:19:11 +08:00
Daming 4cec38b12b Set up github action for E2E and Plugins Tests (#3953) 2019-11-28 21:20:30 +08:00
吴晟 Wu Sheng a3f6325a3e
Update docker-ci.yaml (#3925)
Fix the wrong trigger option.
2019-11-24 21:56:18 +08:00
Gao Hongtao fa2af52cce Extending OAP docker container (#3919)
* Add ext lib and ext config

* Add container checker
2019-11-23 00:42:11 +08:00