Commit Graph

737 Commits

Author SHA1 Message Date
吴晟 Wu Sheng 1ee14fbbc8
Support customized instance name by a new UUID naming policy. (#4148) 2019-12-30 14:59:29 +08:00
Gao Hongtao 4211eff558 Fix os maven plugin issues for Eclipse m2e (#4144)
* Fix mave-os plugin issues for Eclipse m2e

* Add os-msven-plugin.version property
2019-12-29 13:49:27 +08:00
mrproliu 2fcf7c4649 provide config stream processor (#4133)
* provide config stream processor

* 1. rename config to none stream
2. add comments on none stream relate classes

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2019-12-27 14:58:15 +08:00
Weiyi Liu 9415f68127 Fix the wrong comments. (#4139) 2019-12-27 12:10:37 +08:00
aderm e25b1e6008 improve if find parent, quick exit (#4107) 2019-12-26 10:02:42 +08:00
aderm 8476316e96 refactor code. (#4120) 2019-12-25 23:35:35 +08:00
吴晟 Wu Sheng b570996006
Update JDK compiling level to 8, and remove zip dist. (#4119)
* Update JDK compiling level to 8, and remove zip dist.

* Exclude annotation and shade API.

* Fix more exclusion.

* 1. Update grava and gson 2. Fix compile issue. 3. Keep protoc and maven plugin in old version. Some incompatible of 3rd party grpc proto.

* Fix dependency conflicts, license and notice issue, and dependency check script issue

Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
2019-12-25 15:55:24 +08:00
吴晟 Wu Sheng d7f7799c80
Set the main branch to 7.0.0-SNAPSHOT (#4115)
* [maven-release-plugin] prepare release v6.6.0

* [maven-release-plugin] prepare for next development iteration
2019-12-24 16:37:13 +08:00
Gao Hongtao 4ed21e1c9d
Filter endpoint with an id == 0 (#4105) 2019-12-23 11:57:58 +08:00
zhang-wei 4c99480f70 Add relation metrics verification in e2e test (#4080) 2019-12-19 13:26:27 +08:00
Daming f9a849d6be fix typo (#4082) 2019-12-18 21:03:43 +08:00
Juan Pan(Trista) 0fd634092b Modify query SQL for MySQLDAO (#4047)
* Modify MySQLDAO and H2DAO
2019-12-17 23:36:22 +08:00
吴晟 Wu Sheng 5f420bf3ac
Fix service instance relationship ID build bug. (#4075)
* Fix service instance ID build bug.

* Add instance ids into the relation metrics.
2019-12-17 14:12:56 +08:00
kezhenxu94 3f48790c36 [Feature] Add Java agent plugin for Jdk Threading classes (#4067)
* Add Java agent plugin for Jdk Threading

* Fix expected data according to changes in master

* Update agent.config

* Fix failed plugin test
2019-12-17 00:12:14 +08:00
Jared Tan a6d0366c22 support min function. (#4072)
* support min function.

* fix logical bug and update test case.

* the same here.
2019-12-16 22:20:30 +08:00
吴晟 Wu Sheng 4e50132817
Remove the local/exit span register mechanism in Java agent scenario (#4059)
* Remove the local span and exit span register mechanism in Java agent scenario.

* Fix config, plugin, and document, as exit span is not required register anymore.

* Try to fix the test case expected data due to no register for exit span.

* Fix toolkit case.

* Remove exit span from plugin test framework document.

* Update protocol, FAQ, and CHANGELOG documents to highlight this change.

* Fix NPE when no entry span in the whole segment. Set endpoint to null in segment entity.

* Fix the snapshot and add inexistence operation name id.

* Fix several async cases.

* Fix undertow test case.

* Fix wrong error log name.

* Keep name consistent with 6.x concepts.

* Try to fix 3 async scenarios.

* Fix okhttp case.

* Fix Spring Async case.

* Fix another NPE

* Fix NPE when first span has no endpoint id when it is local or exit span.

* Still fill first operation name when no endpoint id.
2019-12-15 19:15:47 +08:00
Gao Hongtao 16d7782a5c
Remove client side endpoint register of service mesh (#4054) 2019-12-13 16:11:33 +08:00
kezhenxu94 eea5d027cc
Add Armeria Java agent plugin (#4024) 2019-12-11 15:57:45 +08:00
mrproliu cfb3379cd0 fix judge NPE when worker not found (#4039) 2019-12-10 23:22:56 +08:00
zhang-wei 3741f4e386 [Feature] Service instance dependency (#3978)
* dispatcher

* getServiceInstanceTopology implementation

* CacheUpdateTimer

* fix compilation failure

* fix compilation failure

* fix esDao

* Update dao list

* dispatcher

* getServiceInstanceTopology implementation

* CacheUpdateTimer

* fix compilation failure

* fix compilation failure

* fix esDao

* Update dao list

* test e2e

* add official_analysis.oal & update getServiceInstanceTopology

* test instance topo for single service

* fix gql

* fix verifyServiceInstances

* verifyServiceInstanceTopo

* fix verifyServiceInstanceTopo

* fix ServiceInstanceInventory#name

* fix ServiceInstanceInventory#name

* e2e test

* fix action

* fix provider port

* fix Instance Node Type

* re run

* fix expected-data

* add e2e mysql

* set @Test timeout

* fix ci

* increase timeout

* re check

* test ttl es7

* test ttl

* fix action

* merge group

* test ttl es7

* replace official_analysis.oal

* replace official_analysis.oal

* comments

* add TODO

* add TODO

* fix filed name
2019-12-09 08:23:21 +08:00
Gao Hongtao 34fd8637c0
Update envoy proto (#4013) 2019-12-06 14:41:54 +08:00
kezhenxu94 aa022ffa00 Remove unused ES7 config (#3998) 2019-12-04 00:20:10 +08:00
Gao Hongtao 87b7afcd64
Distribute "service-apdex-threshold.yml" (#3976)
* Update pom.xml

Exclude "service-apdex-threshold.yml" from jar

* Add service-apdex-threshold.yml to the config folder of release jar
2019-11-29 22:49:32 +08:00
Gao Hongtao 6475ab3d1d Add apdex function to OAL (#3855)
* Add apdex function to OAL

* Add empty line

* Setup config watcher

* Add identifier type to function parameter

* Add config test

* Update score algorithm

* Replace responseCode with status

* Add comments about apdex score algorithm

* Add docs

* Add e2e test case

* Update test case

* Fix disptch class generating error

* Update value name of apdex metric

* Tuning threshold

* Fix single tolerated point bug
2019-11-29 12:54:33 +08:00
Stalary b666dc7e11 MOD:alarm-settings.yml support exclude-names (#3949) 2019-11-28 22:25:08 +08:00
Jared Tan d581f2294f Support custom elasticsearch settings in index level. (#3913) 2019-11-21 22:30:59 +08:00
kezhenxu94 9b408e82d5 [Feature] Support ElasticSearch 7 as backend storage (#3870)
* [Feature] Officially support ElasticSearch 7 as backend storage

* Extract bootstrap module to be shared by multiple starters

* Add missing configuration file and distinguish different version in test

* Update known-oap-backend-dependencies-es7.txt

Update the dependency lib

* Fix missing adaptation to ElasticSearch 7

* Rename ElasticSearch 7 specific class with Es7 infix

* Fix miss-adapted ElasticSearch DAO API

* Add ES7 specific configuration and polish documentations

* Polish documentations

* Polish documentations
2019-11-21 09:26:23 +08:00
吴晟 Wu Sheng 0724cdb42d
Support ordered segment list in trace query (#3906)
* Sort the segment fragments

* Add comment.

* Remove unnecessary box codes.
2019-11-20 22:39:51 +08:00
Jared Tan 5d064ced5f make topN worker report period configurable. (#3892) 2019-11-19 17:26:30 +08:00
于玉桔 6ffd92792d Support spring-tx in optional plugin (#3857)
* plugin code

* NPE FIX
2019-11-19 10:05:01 +08:00
surechen 96a3e34243 Add componentId for apache servicecomb. (#3676)
* Add componentId for apache servicecomb.

* Edit according to comment

* add servicecomb

* Edit according to comment

* fix
2019-11-19 06:58:15 +08:00
Jared Tan 70f94d577c
make sql statement more semantic. (#3882)
* set no statement.

* update sql.

* update statement.

* revert threshold.
2019-11-18 21:30:25 +08:00
吴晟 Wu Sheng 2c4caedabb Update joda lib to fix UTC +13/+14 bug (#3876)
* Update joda lib to fix UTC 13/14 bug

* Change the dependencies file.
2019-11-17 23:18:28 +08:00
吴晟 Wu Sheng d7038fe67b
Refactor DataCarrier, support ArrayBlockingQueueBuffer as implementor (#3849)
* Refactor DataCarrier, support ArrayBlockingQueueBuffer as the implementation for blocking queue buffer.

* Fix style issue.

* Remove import.

* Remove uesless codes.
2019-11-15 23:33:40 +08:00
于玉桔 db0b7486a5 fix component-libraries.yml miss component:rest-high-level-client (#3859)
* fix component-libraries.yml miss component:rest-high-level-client

* Update component-libraries.yml

Add mapping.
2019-11-14 17:59:59 +08:00
aderm e11d20715d Add elasticsearch 6.x plugin & elasticsearch 6.x test scenario (#3803)
* Add elasticsearch 6.x plugin & elasticsearch 6.x test scenario
2019-11-13 13:55:28 +08:00
吴晟 Wu Sheng 3fbaec42dc
Move to 6.6.0 SNAPSHOT (#3839)
* [maven-release-plugin] prepare release v6.5.0

* [maven-release-plugin] prepare for next development iteration
2019-11-12 22:33:39 +08:00
zhang-wei c35c6f2a2e fix consul repeated invoker KVCache.newCache (#3833) 2019-11-11 22:26:21 +08:00
YuXiaoFeng 455f69ad9e Enhance EtcdCoordinator if disconnected from etcd server for a long time (#3782)
* Update EtcdCoordinator.java

when EtcdCoordinator cannot connect to etcd cluster for a long time, 
the information registered in etcd will expire and refresh() function will not work.
2019-11-05 13:51:29 +08:00
Jared Tan fbabcb1782 make query max window size configurable. (#3765)
* fix elasticsearch query data window size too large error.

* make query max window size configurable.
2019-11-01 16:02:06 +05:30
吴晟 Wu Sheng e9b404f1fa
Remove two max size 500 limit. (#3748) 2019-10-30 18:34:33 +05:30
于玉桔 d9b3ab8430 fix a typo (#3744) 2019-10-30 15:20:16 +05:30
吴晟 Wu Sheng 42d422e852
parameterize the cache size. (#3741) 2019-10-30 11:15:11 +05:30
Jared Tan 852f03d1db
remove unused time range query parameter. (#3730) 2019-10-28 22:21:54 +08:00
qiyang 69a28d4591 Add register persistent worker latency metrics #3671 (#3677)
* Add register persistent worker latency metrics  #3671

* remove never thrown exception on Time#close()
add panel to mesh-mode-grafana.json

* remove never thrown exception on Time#close()
add panel to mesh-mode-grafana.json
2019-10-24 15:22:38 +08:00
mrproliu c640b512cd Provide agent plugin netty-socketio (#3640)
* add plugin netty-socketio https://github.com/mrniko/netty-socketio

* delete create exit span interceptor.

* delete create exit span interceptor testcase.

* delete create exit span interceptor testcase.

* add constructor test unit

* change bind on random port in test case

* reverse upstream master whitespace

* resolve build_id param

* delete health check segment test case

* add ContextManager.isActive check before use activeSpan invoke

* remove unnecessary code and blank line
2019-10-23 13:06:17 +03:00
Jared Tan 2f3d009e63 Makes the scope of alarm message more semantic. (#3680)
* Makes the scope of alarm information more semantic.

* update md.

* update md.

* add ruleName in AlarmMsg.

* update md.

* update test case.

* fix coveralls.

* fix coveralls.

* fix ci.
2019-10-22 19:35:04 +03:00
coki230 cbb2755093
ServiceInstanceRelation set error id
the SourceServiceId set error id which is destServiceId.
2019-10-22 14:49:15 +08:00
Kdump c0be757f43 add graphql getServiceInstance instanceUUID field. (#3595)
* add graphql getServiceInstance instanceUUID field.

* add graphql getServiceInstance instanceUUID field.

* add graphql getServiceInstance instanceUUID field.

* sync query-protocol repo

* add instanceUUID field e2e

* add instanceUUID field e2e

* add instanceUUID field e2e

* add instanceUUID field e2e
2019-10-17 06:38:00 +03:00
Yanick.xia d68c0883ed Fix more resonable error (#3619)
* Fix #3402

* Fix unecessary blankline

* Optimize rebuild logic

* Fix checkstyle fail

* Add concurrency test

* Fix text mistakes

* Optimize refresh logic && new test for return clients never change by refresh logic

* Make unit test more clearness

* Add more unit test && fix a bug

* Rename variable && format by skywalking style
2019-10-16 19:33:54 +03:00
panjuan fb001867e5 Instead of datasource-settings.properties, use application.yml for MySQLStorageProvider (#3564)
* Is it a typo or not?

* delete datasource-settings.properties

* handle 'metadataQueryMaxSize'

* delete DynamicModuleConfig.java

* modify mysql config

* parsing yaml to support the configuration for multiple properties

* delete datasource-settings.properties

* modify doc

* add properties for docker-entrypoint.sh

* add testLoadConfig()
2019-10-12 20:47:38 +08:00
echooymxq 1b1e80b75a Optimize code (#3600) 2019-10-11 19:17:03 +08:00
mrproliu 58804174e1 Provide plugin for Ehcache 2.x (#3575)
* support ehcache 2.x
2019-10-10 22:39:37 +08:00
吴晟 Wu Sheng 713995f9c6
Adjust dependency (#3592)
* This dependency should be added.

* Fix again.
2019-10-10 19:11:26 +08:00
吴晟 Wu Sheng 6c1a8f74b0
This dependency should be added. (#3586) 2019-10-10 13:39:04 +08:00
吴晟 Wu Sheng 3cdc1a1928
Fix 5 places of using wrong Strings util (#3582)
* Exclude a dependency for test.

* Fix 5 places of using wrong Strings util.
2019-10-09 22:55:01 +08:00
kezhenxu94 72b722a5c1 Support namespace in Nacos cluster/configuration (#3578)
* Support namespace in Nacos cluster/configuration

* Give Nacos default namespace as per config/registry
2019-10-09 16:25:47 +08:00
Jared Tan 2db2638fc2 code cleanup: remove unnecessary and optimize the function's parameters. (#3577)
* code cleanup: remove unnecessary and optimize the function's parameters.

* fix code style.
2019-10-09 10:05:23 +08:00
kezhenxu94 114a74f35a
Fix some miscellaneous bugs (#3567) 2019-10-07 17:35:22 +08:00
aderm 7d3b285b6b 提取公共代码 (#3566) 2019-10-07 16:49:13 +08:00
kezhenxu94 2801de752f Support dynamically configure alarm settings (#3557)
* Support dynamically configure alarm settings

* Update documentation
2019-10-05 22:47:01 +08:00
kezhenxu94 81f4c087b0
Provide Consul dynamic configuration center implementation (#3560)
* Provide Consul dynamic configuration center implementation

* Add more unit tests

* Fix unit test

* Add more unit tests and remove unused file

* Remove redundant doc
2019-10-05 10:49:53 +08:00
kezhenxu94 179914d7b9 Upgrade guava version to support higher JDK version (#3541)
* Upgrade guava version to support higher JDK version

* Adjust license version

* Update doc
2019-09-30 13:29:03 +08:00
lipenghui a87425147c Add pulsar apm plugin (#3476)
* Add pulsar apm plugin.

* Fix check style

* Fix pulsar consumer component define.

* Add pulsar to component-libraries.yml

* Fix error interceptor class.

* Add pulsar to agent support list.

* Add Pulsar to ComponentsDefine and component-libraries.yml

* Move create entry span log of consumer from after method to before method

* Fix send callback issue when exception cause.

* Fix test issues

* Move pulsar plugin to optional plugins

* Add none messages tests for interceptor of producer and consumer.

* Remove unused comments.

* Move pulsar plugin back to the apm-sdk-plugin

* Fix comments

* remove set startTime for entry span(default is set by System.currentTimeMillis)

* Fix comments
2019-09-25 13:24:54 +08:00
吴晟 Wu Sheng c05e63353d
Sync latest ALS from Envoy API (#3507) 2019-09-23 10:02:33 +08:00
Kdump 058335f21a Query server time info (#3498)
* sync ui

* query-server-time-info

* query-server-time-info

* query-server-time-info

* query-server-time-info

* query-server-time-info

* sync skywalking-query-protocol

* sync ui

* sync ui

* sync skywalking-query-protocol

* sync skywalking-query-protocol
2019-09-22 19:06:33 +08:00
吴晟 Wu Sheng 8ebf3aac04
Support timeout configuration in agent and backend. (#3491)
* Support timeout configuration in agent and backend.

* Fix CI

* no message
2019-09-20 15:02:28 +08:00
Gao Hongtao 09064e97a8 Set telemetry instanced id for etcd and nacos plugin (#3492)
* Update docker-entrypoint.sh

* Set telemtry instance id in etcd and nacos plugins
2019-09-20 11:35:22 +08:00
吴晟 Wu Sheng 6942ec8fcf
Language of instance could be NULL (#3485)
* Language of instance could be NULL

* Fix style check.

* Fix duplicated test cases.
2019-09-19 00:23:11 +08:00
Louis Tsui 72f07b812a Add Light4j plugin (#3323)
* Add Light4J 1.6.x plug-in

* Add unit test for Light4J plug-in

* Add missing id to server-starter

* Remove mentions of version 1.6.x

Some local testing showed that the plugin successfully generated traces for a light4j project built with light-codegen v2.x. Therefore, there is no need for a separate plugin for v2.x and no distinction needs to be made with light4j v1.6.x.

* Update supported light4j versions

* Use ContextSnapshot to maintain trace

In a typical Light4j project, the ExceptionHandler#handleRequest is the asynchronous execution point. The flow is ExceptionHandler#handleRequest -> HttpServerExchange#dispatch -> ... -> ExceptionHandler#handleRequest. This means that handleRequest is being intercepted twice and each time a LocalSpan is created. Without handling thread propagation, the trace segment gets split up.

By saving a ContextSnapshot into the enhanced object (ExceptionHandler), we can determine if it is necessary to continue the segment.

* Update logic for span creation in trace

By default, the Light4J plugin now overrides the Undertow plugin's entry span with its own. This new entry span is created just before execution of the ExceptionHandler#handleRequest in the I/O thread. The entry span is generated here because it is considered the starting point of the Light4J handler chain.

There is now also the option to enable detailed span creation when tracing requests through Light4J. These local spans mark which middleware and business handlers are involved with handling the HTTP request to a Light4J service.

* Update skywalking version

* Update light4j version

* Fix LightInstrumentation javadoc

* Remove import violating checkstyle

This import was added from the link reference in the javadoc. The javadoc has now been changed to just reference the method name.

* Move light4j agent config property

* Sync UI
2019-09-18 21:43:17 +08:00
Jared Tan 6c347a1169 agent support custom properties. (#3367)
* agent support custom properties.
2019-09-17 14:44:42 +08:00
吴晟 Wu Sheng 06c357da6c
Make sure the cluster register happens before streaming process. (#3471) 2019-09-17 08:53:02 +08:00
stone.wlg bb0b3d369f provide cassandra java driver 3.x plugin (#3410)
* add cassandra java driver 3.x plugin
2019-09-12 16:14:48 -07:00
kezhenxu94 721f86485c Add TTL E2E test (#3437)
* Add TTL E2E test

* Add to Jenkins stage and minor bugfix

* Upgrade e2e container version

* Polish and minor fix

* Polish
2019-09-09 22:06:57 -07:00
吴晟 Wu Sheng ce20fe107d
Move to 6.5.0 (#3439)
* [maven-release-plugin] prepare release v6.4.0

* [maven-release-plugin] prepare for next development iteration
2019-09-08 16:24:21 -07:00
于玉桔 a690f6704f add gateway.yml to avoid unnecessary errors (#3426) 2019-09-06 08:12:45 -07:00
Jared Tan dbbf22a177 support es https ssl config. (#3370)
* support es https ssl config.

* update

* update docs.

* refactoring var name.

* fix

* update docs.

* add config in es section.

* fix logical.
2019-09-02 11:15:43 +08:00
吴晟 Wu Sheng 2a2679eefb
Fix Pxx calculate bug. (#3391) 2019-09-02 10:14:33 +08:00
康智冬 70b825ce43 fix typo (#3388) 2019-09-01 08:35:32 +08:00
kezhenxu94 6fd85c8303
Avoid unnecessary resetting when service mapping id is already 0 (#3383)
* Avoid unnecessary resetting when service mapping id is already 0

* Avoid as early as possible and minor optimization

* Remove unused import

* Polish
2019-08-30 23:54:54 +08:00
kezhenxu94 54614a0594 Support gateway without agent (#3308)
* Support Gateway without agent
2019-08-30 16:17:41 +08:00
Andy Ai 8bf7e346ee Support play 2.x (#3207)
* Support play 2.x
2019-08-29 17:00:51 +08:00
Jared Tan cadaab03ae
set alarm record ordered by start time desc. (#3353) 2019-08-28 09:56:55 +08:00
彭勇升 pengys 3264fd4e31 Fixed #3328, keyword data type is not long enough for saving PXX metrics. (#3332) 2019-08-26 16:33:55 +08:00
webb2019 429c9b3c9c Data binary limit (#3321)
*  fix "DATA_BINARY" limit VARCHAR(20000)
2019-08-26 09:40:37 +08:00
webb2019 f0acf9b61f slow sql long string trim (#3318)
*  slow sql long string trim

*  fix slow sql has long string
2019-08-25 21:21:48 +08:00
Daming 49b20dd0cb Support Zookeeper ACL (#3273)
* support ACL

* support digest only
2019-08-21 09:23:43 +08:00
吴晟 Wu Sheng dc0f6530cb
Fix TTL issue. (#3292)
* Fix TTL issue.

* Fix issue.

* Rename `getSecondTimeBucket` to `getRecordTimeBucket`.
2019-08-20 15:36:31 +08:00
吴晟 Wu Sheng 8888029e9a
Module config set override is not working (#3283)
* set Override is not working.

* Submodule update

* Add header.
2019-08-17 10:10:30 +08:00
kezhenxu94 db9759fcc2 Check license header strictly (#3274)
* Check license header strictly

* Ignore header template

* Include more files to check list
2019-08-16 14:37:44 +08:00
于玉桔 a0e816771c Webflux plugin optimization (#3243)
* webflux
2019-08-13 22:52:01 +08:00
于玉桔 73cf05c5b9 fix component-libraries typo (#3241) 2019-08-10 17:07:18 +08:00
Jared Tan 02affffa50 support elasticsearch address configuration with http scheme. (#3236)
* support elasticsearch address configuration with http scheme.

* update logical.
2019-08-09 19:15:04 +08:00
yantaowu 1bfda1dd65 Modify the thread pool of grpc server. (#3225)
* Modify the thread pool of grpc server.

* add license header

* make param confingable

* Add sharing and Jaeger config.

* Remove grpc thread config from yml
2019-08-09 09:14:55 +08:00
吴晟 Wu Sheng 0df76e4e38
Remove the scope-meta file (#3226)
* Remove the meta file
2019-08-07 17:35:12 +08:00
kezhenxu94 37acc3dc99 Add dependency licenses check (#3221)
* Add dependency licenses check
2019-08-07 09:45:23 +08:00
吴晟 Wu Sheng b247dc979e
Move project master branch to 6.4.0-SNAPSHOT (#3220)
* [maven-release-plugin] prepare release v6.3.0

* [maven-release-plugin] prepare for next development iteration
2019-08-05 21:19:17 +08:00
吴晟 Wu Sheng e74637a261
GC time metrics should be total time. (#3216)
* GC time metrics should be total time.

* Add it to change log.

* FYI @hanamily you missed to change this in self observability.
2019-08-05 11:46:12 +08:00
li.can 6e837153f2 Add jdk http plugin (#3171)
* add http

* update plugin

* Add StaticMethodsAroundInterceptor to be injected.

* move to options plugin

* move folder

* update pom

* support https

* add witness class

* Make JDK9-11 available for bootstrap instrumentation

* Remove temp folder of old bootstrap instrumentation requirement.

* remove witness ,work for jdk6,7,8,9,10,11

* Make JDK 12 works.

* move jdk-http-plugin to bootstrap-plugins folder

* add httpsclient

* update README.md
2019-08-03 10:26:20 +08:00
kezhenxu94 49f50a24a4 Support upgrade backend w/o rebooting agents (#3170)
* Support upgrade backend w/o rebooting agents
2019-08-02 09:25:17 +08:00
kezhenxu94 e8f94d55c3 Fix bug: NetworkAddressInventory uses wrong builder to convert data (#3183) 2019-07-29 14:07:37 +08:00
Alan Lau 76d91635ee Support etcd configuration. (#2973)
* Support etcd configuration.
2019-07-27 22:02:40 +08:00
彭勇升 pengys 16b8236506 1. All the inventories add last_update_time attribute, delete the mapping_last_update_time attribute in service inventory. (#3168)
2. Fixed the service inventory and net address inventory update bugs.
2019-07-26 14:02:27 +08:00
彭勇升 pengys f658d9eb4d Simplify the PxxMetrics and ThermodynamicMetrics to improve performance (#3162)
* Feature of database session

* Make it configurable.

* Change the metrics process flow.
before: metrics entrance -> aggregate worker -> remote worker -> trans worker -> minute, hour, day, month persistence worker -> storage
after: metrics entrance -> aggregate worker -> remote worker -> minute persistence worker ->  trans worker -> hour, day, month persistence worker -> storage

* IntKeyLongValueHashMap instead of IntKeyLongValueArray.

* Make the OAP server can't startup.

* Finish

* Rename the method and fixed some test case issues.

* Rename field.

* no message
2019-07-25 19:08:36 +08:00
彭勇升 pengys 8605f4ccc0
Change the metrics process flow. (#3157)
* Feature of database session

* Make it configurable.

* Change the metrics process flow.
before: metrics entrance -> aggregate worker -> remote worker -> trans worker -> minute, hour, day, month persistence worker -> storage
after: metrics entrance -> aggregate worker -> remote worker -> minute persistence worker ->  trans worker -> hour, day, month persistence worker -> storage
2019-07-24 18:18:20 +08:00
Gao Hongtao 924f25fec4
Self observability of OAP backend (#3140)
* First commit

* Fix e2e test and some nits

* Documenting so11y and setting default values of it in dev env
2019-07-24 16:08:56 +08:00
彭勇升 pengys 8d234a91e5 Feature of database session in OAP server. (#3147)
* Feature of database session

* Make it configurable.

* Make the OAP server can't startup.
2019-07-24 13:43:19 +08:00
吴晟 Wu Sheng f83dc64602
Fix a wrong comment. (#3134) 2019-07-21 18:38:19 +08:00
彭勇升 pengys 8306ad4531 Reduce the number of threads to improve performance. (#3133)
* Refactor Persistence worker.

* 1. Provide InsertRequest and UpdateRequest interface for prepare persistence.
2. Implement the ids query for H2 metrics DAO.

* Refactor worker framework

* Use queue to receive asynchronous batch request.

* Rename the Datacarrier thread name.

* Fixed some mistake.

* New mistake.
2019-07-21 15:51:24 +08:00
吴晟 Wu Sheng ab9bc9226b Fix H2 metrics read bug, can't read expected existing metrics. (#3132)
Make agent mock works as usual.
2019-07-21 15:07:35 +08:00
彭勇升 pengys 594994ffae 1. Provide InsertRequest and UpdateRequest interface for prepare persistence. (#3131)
2. Implement the ids query for H2 metrics DAO.
2019-07-21 13:56:12 +08:00
彭勇升 pengys 6de3e55280 Too many EndOfBatchContext instance created. (#3129) 2019-07-21 00:26:17 +08:00
吴晟 Wu Sheng d256fc348e OAP internal RemoteService protocol change and code refactor (#3128)
* Remove the worker id, and add worker name for remote handler only.

* Remote metrics and inventory classes mapping too.

* Refactor codes.
2019-07-20 23:47:17 +08:00
彭勇升 pengys 6338de392f Improve OAP server performance. (#3127)
* Improve OAP server performance.
2019-07-20 22:59:52 +08:00
彭勇升 pengys 8d70533921 Fixed buffer lost. (#3118) 2019-07-19 22:07:53 +08:00
彭勇升 pengys ed507b78ef
Dirty-Read in concurrency (#3117)
* Fixed the problem of dirty reading of the storage implementation of elasticsearch.

* Fixed a mistake.
2019-07-19 14:22:01 +08:00
吴晟 Wu Sheng 5b039e9747 All NEW OAL Runtime Engine (#3109)
* Change OAL generator tool to runtime.

Step 1. change project structure. API links and maven pom.

* Part of metrics class generation

* Metrcis class generated.

* Set up the basic structure of new OAL engine.

* Finish metrics generation.

* Support dispatcher generation.

* Format codes.

* Generate dispatcher all methods.

* Implement disable in hardcode.

* Clear up

* Fix compile startup.

* Update license and document of new OAL engine.

* Fix rat.

* Disable class output in default

* Copy from @kezhenxu94 's test PR, https://github.com/apache/skywalking/pull/3110

* Wait for the mount command to finish
2019-07-18 19:47:23 +08:00
彭勇升 pengys d4c7006525
Config item name is wrong. (#3101) 2019-07-17 17:24:00 +08:00
zhangwei ed99079d20 Fix service cluster plugin bug (#3074)
* fix 3069
2019-07-17 14:40:45 +08:00
彭勇升 pengys 54b01223de Aggregate worker will hold the metrics while there is no new metrics in. (#3100) 2019-07-17 13:59:54 +08:00
彭勇升 pengys 1057463812 Correct spelling errors in the network protocol. (#3091)
* Correct spelling errors in the network protocol.

* update protocol submodule commit id.
2019-07-16 09:19:48 +08:00
彭勇升 pengys 9025359163 Fixed a mistake that inject v1 segment producer into v2 standardization worker. (#3090) 2019-07-15 23:13:04 +08:00
kezhenxu94 4db1773d3e Fix wrong logger names (#3075)
* Fix wrong logger name

* Fix more wrong logger names in agent side
2019-07-15 00:35:15 +08:00
吴晟 Wu Sheng 34b63ae135
Make persistent period configurable. (#3070) 2019-07-14 16:13:32 +08:00
彭勇升 pengys 10449aa51c Logger class is incorrect. (#3054) 2019-07-12 09:46:36 +09:00
Alan Lau 52b674e3a5 Fix isSelf address. (#3051) 2019-07-12 08:25:41 +09:00
zhangwei deb2d90029 fix deleteIndex repeat append namespace (#3017)
* fix deleteIndex repeat append namespace

* fix deleteIndex repeat append namespace

* fix checkStyle

* fix

* fix test assert

* update test method name

* fix test

* fix

* del elastic.search.namespace

* fix check style

* update ITElasticSearchNamespaceClient to ITElasticSearchClientOfNamespace

* move undoFormatIndexName to ITElasticSearchClien

* move #getIndex to ITElasticSearchClient

* add deleteByModelName and deleteByIndexName

* add deleteByModelName and deleteByIndexName

* revert ITElasticSearchClient#getIndex

* Use whitebox get from powermock to get this.

* undo namespacePrefix
2019-07-12 07:53:11 +09:00
吴晟 Wu Sheng 8b2cfa2cd8 Try to fix MySQL TTL failure. (#3038) 2019-07-10 23:29:13 +08:00
吴晟 Wu Sheng ba24490166 Remove "IDs can't be null" in backend, as UI hasn't fixed this for a long time. (#3039) 2019-07-10 17:32:45 +08:00
Gao Hongtao 01b963c109 Adding deadline to gRPC client (#2987)
* Set up 10 seconds deadline after gRPC client sending
 * The duration of deadline contains three segments: connecting,
   request and response

For blocking stub, I just set deadline before invoke service. For
bi-streaming stub, I found all of them are used as a blocking style,
that after getting streaming response client stub just close current
streaming. Base on above reality, I pick the same way as blocking one.
2019-07-03 14:34:04 +08:00
kezhenxu94 9d7649d907 Set charset in web hook and replace magic number (#2986) 2019-07-03 09:22:53 +08:00
zhousiliang163 6c85693ca1 fix issue #2979 (#2980)
* fix issue #2979

* remove the unused import, which causes the CI failed
2019-07-02 11:34:19 +08:00
于玉桔 48ffd09239 Spring @Async plugin support (#2902)
* spring_async_plugin

* fix

* fix

* fix

* fix

* format fix

* rename

* fix

* fix version

* Update SWCallable.java

* Update Supported-list.md

* Update Supported-list.md
2019-07-02 07:46:25 +08:00
吴晟 Wu Sheng 0225711e26
Check duplicate providers in bootstrap (#2976)
* Enhance module manager
2019-07-01 15:54:12 +08:00
吴晟 Wu Sheng 11e7cd44f7
[Revert]etcd configuration is not implemented (#2974)
* etcd configuration is not implemented and the provider definition is copied from cluster management, which could cause multiple loading by module manager.

* Fix a missing delete.
2019-07-01 11:03:38 +08:00
吴晟 Wu Sheng 4faa950c14
Move master to 6.3.0 (#2968)
* [maven-release-plugin] prepare release v6.2.0

* [maven-release-plugin] prepare for next development iteration
2019-06-29 13:49:36 +08:00
daming 6827839c21 typo (#2960) 2019-06-27 19:34:17 +08:00
daming 1e584ddf50 fix missed condition in H2LogQueryDAO (#2947)
* fix missed condition

* fix missed condition

* fix missed condition
2019-06-26 15:23:02 +08:00
彭勇升 pengys dea6cfb010 Change the statement column type from Keyword to Text. (#2944)
* Use ids query method instead of get method for metrics persistence.

#2933

* Query by alias name.

* #2943

Change the statement column type from Keyword to Text.
2019-06-25 17:55:12 +08:00
吴晟 Wu Sheng 4deae17fb3 Fix lose query data bug. (#2941) 2019-06-25 15:06:31 +08:00
吴晟 Wu Sheng 85acc1b191
Revert "Introduce dead line settings from gRPC document. (#2917)" (#2936)
This reverts commit db8c45465b.
2019-06-24 00:08:59 +08:00
彭勇升 pengys 129d2918ac Use ids query method instead of get method for metrics persistence. (#2934)
* Use ids query method instead of get method for metrics persistence.

#2933

* Query by alias name.
2019-06-23 16:53:45 +08:00
daming fa7a1983f9 Fix ModuleProvider is repeated loading (#2923) 2019-06-21 21:01:20 +08:00
吴晟 Wu Sheng db8c45465b Introduce dead line settings from gRPC document. (#2917) 2019-06-21 00:53:31 +08:00
于玉桔 adb7ac44d7 Provide Zookeeper dynamic configuration center implementation. fixes #2825 (#2852)
* configration-zookeeper
2019-06-18 13:53:28 +08:00
kezhenxu94 5df621390f Remove unstable test temporarily (#2893)
Nacos standalone mode don't use in-memory storage therefore we don't
need mysql
2019-06-18 09:38:20 +08:00
daming 6ff33d8816 Restore solrj-plugin (#2888)
* restore solrj-plugin

* restore solrj-plugin
2019-06-17 18:48:18 +08:00
彭勇升 pengys 70064f47cb Use the ids query method instead of get method. (#2887)
#2886
2019-06-17 12:05:21 +08:00
Alan Lau a70a2b236e Add cluster-etcd-plugin (#2725)
* Add cluster-etcd-plugin
2019-06-17 11:27:40 +08:00
kezhenxu94 fac940cdbe Provide Apollo dynamic configuration center implementation. fixes #2825 (#2826)
* Provide Apollo dynamic configuration center implementation. fixes #2825
2019-06-16 22:49:44 +08:00
kezhenxu94 e3e06bb024 Bump up fabric docker plugin version (#2875) 2019-06-14 15:16:09 +08:00
吴晟 Wu Sheng 13303fb51e
Support pxx in service relation. (#2785) 2019-06-14 13:30:06 +08:00
吴晟 Wu Sheng 0103d8ad28
Fix no stream register. (#2873)
* Fix no stream register.

* Make sure list order.

* Refactor codes.

* Fix wrong revert.
2019-06-14 11:31:51 +08:00
吴晟 Wu Sheng 0f9c27d481
Revert SolrJ plugin. (#2871)
* Revert SolrJ plugin.

* Remove an unexpected test case.

* Revert "Remove an unexpected test case."

This reverts commit 359990e18b0c0ae1a6e1005ff985bf237ec05619.

* Clear context.

* Fix a leak.
2019-06-14 09:24:58 +08:00
kezhenxu94 5b6a890592 Adjust pom plugin position and add docs (#2870)
* Adjust pom plugin position and add docs

* Polishing

* Update as requested
2019-06-14 07:21:47 +08:00
tzy1316106836 bc0c25ad55 the static paramater is best to be referenced by the class (#2868)
* fix potential NullPointerException

* Revert "fix potential NullPointerException"

This reverts commit 8393656

* fix potential NullPointerException
the static paramater is best to use the class to reference
2019-06-13 20:23:46 +08:00
kezhenxu94 f5db90b8bd Integrate Jenkins CI (#2864)
* Test

* Sync

* Update ITNacosConfigurationTest.java

* Trigger CI

* Trigger CI

* Trigger CI

* Trigger CI

* Trigger CI

* Remove unused imports to fix checkstyle

* Remove unused imports to fix checkstyle

* Increase timeout since nacos starts slowlly

* Bump up Oracle JDK version

* Remove OracleJDK due to license

* Add CI-with-IT profile and openjdk9

* Add missing profiles

* Lift failsafe plugin to root

* Update pom.xml

* Remove OPENJDK9

* Try parallel builds and add agent

* Try parallel build and windows

* Try parallel build and windows

* Try parallel build and windows

* Try parallel build

* Try parallel build

* Try parallel build

* Fix indentation

* Trigger CI

* Trigger CI

* Remove Windows stage

* Update mvnw.cmd
2019-06-13 17:06:21 +08:00
彭勇升 pengys 4e63331d35 #2860 (#2861)
Get the document by index name.
2019-06-12 18:56:11 +08:00
吴晟 Wu Sheng dbb8bd8a7f Fix wrong query condition (#2858) 2019-06-12 17:17:15 +08:00
于玉桔 ee7c4180ca Optimize SegmentParseV2::parse code logic (#2828)
* Optimize code logic

* revert

* fix
2019-06-12 12:26:34 +08:00
彭勇升 pengys 1c545a3708 Fixed a time series bug about downsampling setting in processors are different from the setting in receivers. (#2856)
#2851
2019-06-12 08:17:15 +08:00
kezhenxu94 ec731b2ad8 Remove unnecessary docs and config keys (#2845) 2019-06-11 00:20:26 +08:00
吴晟 Wu Sheng c983d85000
Fix miss change of envoy receiver. (#2844) 2019-06-10 16:15:34 +08:00
吴晟 Wu Sheng 2cdbe83f9c
Move zipkin and jaeger span source to disable from metrics. (#2842) 2019-06-09 22:36:52 +08:00
kezhenxu94 f683850b9a Improve plugin performance (#2838)
* Improve plugin performance. fix #2837
2019-06-09 15:19:04 +08:00
kezhenxu94 e05e092677 Remove unstable tests (#2841) 2019-06-09 14:02:01 +08:00
吴晟 Wu Sheng 2197820577
Support exporter runs in increment and total modes (#2840)
* Make exporter interface better.

* Fix review.
2019-06-09 11:32:27 +08:00
kezhenxu94 7f2277091d Provide Nacos dynamic configuration center implementation. fixes #2816 (#2817)
* Provide Nacos dynamic configuration center implementation. fixes #2816

* Add unit tests

* Sync

* Replace pull-mode with watch-mode

* Fix ci

* Unify dependency management

* Add integration tests

* Revert unexpected changes

* Add more test cases

* Revert unexpected changes

* Suppress IDE warning

* Correctify volumes position

* Add license header

* Remove Chinese comments

* Sync

* Sync

* Sync

* Sync

* Revert unexpected changes

* Rebase on refactored code and add missing config to docker

* Fix unit test

* Revert unnecessary changes
2019-06-07 12:01:24 +08:00
kezhenxu94 57aedb8017 Refactor ConfigWatcherRegister to only read interested configs. fixes #2834 (#2835) 2019-06-07 07:32:57 +08:00
daming 6ae517423c Provide plugin for Solr-7.x(client) (#2730)
* new branch for solrj-plugin

* rollback and add module solrj-plugin

* preparing to pr

* to resolve reviewers' suggestions

* remove unused code

* remove unused code

* remove unused comments

* To avoid NPE

* fix typo

* Change to JRE6

* fix pom.xml merge incorrectly. and java.net.URL instead of Regex

* Using RuntimeContext instead of ThreadLocal

* To reduce unnecessary tags

* add test cases

* fix validation fail

* add solrj-plugin into component-libraries & Supported-list

* to trace all patch to avoid recheck status of span

* remove unnecessary properites

* remove unnecessary tags

* Add the config to document of setup
2019-06-05 22:54:45 +08:00
彭勇升 pengys 1f7125a02e Remove storage annotation. (#2813) 2019-06-04 09:53:50 +08:00
吴晟 Wu Sheng 2e846c6078 Dynamic Configuration and Dynamic Configuration Service (#2810)
* Implement the base of config API module.

* Finish configuration module codebases w/o tests, revert some changes.

* Finish mock tests.

* Add new gRPC service for configuration.

* Make gRPC configuration sync provider works.

* Add database slow statement dynamic setting.

* Finish the dynamic configuration service.

* Fix version.
2019-06-03 23:11:52 +08:00
彭勇升 pengys 5036e83343 Good news of an important feature: time series implementation in Elasticsearch storage. (#2808)
* The new feature of Elasticsearch storage with the time series implementation.

* Time bucket util improve.

* Fixed some Gramma error.

* Update ttl.md

Polish English a little.

* Update ttl.md

Add more explicit description of TTL

* Update ttl.md

* Update StorageModuleElasticsearchConfig.java

Set otherMetricsDataTTL = 0 as default, make user more clear.

* Rename the timeSeriesAble to capableOfTimeSeries

* Fixed a test case failure.
2019-06-03 18:46:42 +08:00
彭勇升 pengys 0a696813c8 Time bucket util improve. (#2795) 2019-05-31 15:02:49 +08:00
彭勇升 pengys de46ee62d3
Make the step just to be the graphql java object. (#2792)
* Make the step just to be the graphql java object.

* Mistake.
2019-05-31 13:16:59 +08:00
Gao Hongtao 4f89ea2704 Filtering pods not in 'Running' phase (#2771)
* Filtering pods not in 'Running' phase

* Amending checkstyle errors
2019-05-28 16:05:36 +08:00
FuCheng,Yan bc6f06f964 Support RESTEasy 3.x (#2665)
* feat(agent sdk): resteasy plugin

* fix(agent sdk): fix component define

* fix(agent sdk): fix file license

* fix(agent sdk): fix file license

* docs(agent sdk): add supported list

* fix(agent sdk): fix file license

* fix(agent sdk): fix response error tag

* fix(agent sdk): fix

* fix(agent sdk): adapter 3.5+

* fix(agent sdk): remove unreasonable async handling
2019-05-24 22:14:43 +08:00
QIliang 3e2fb7880d Scope needs to be replaced with entityId (#2742)
"scope" can not find in serviceInventoryCache, serviceInstanceInventoryCache or endpointInventoryCache.
It needs to be replaced with entityId
2019-05-23 16:07:28 +08:00
吴晟 Wu Sheng effe49a102
NPE fix (#2732) 2019-05-22 18:38:18 +08:00
吴晟 Wu Sheng 595498e787
New topology query protocol implementation (#2654)
* Make backend fits new topology query protocol and logic.

* Change topology line id.

* Change endpoint point id rule to match service relation id rule.

* Refactor util.

* Revert wrong refactor by IDEA.

* Revert some changes.

* Fix entity id bug.

* Fix endpoint topology query

* Update UI.

* UI license update.
2019-05-21 14:50:29 +08:00
于玉桔 98b495ebcc Spring cloud gateways 2.1.x plugin (#2517)
* spring cloud gateways plugin
2019-05-20 17:06:40 +08:00
吴晟 Wu Sheng 7b21c337e0
Fix NPE when ALS is off. (#2715) 2019-05-19 23:51:17 +08:00
吴晟 Wu Sheng 3ca7f7b73c
Support ALS and observe service mesh without Mixer (#2460)
* Add ALS proto and receiver in envoy
2019-05-17 15:29:38 +08:00
彭勇升 pengys 4eb5def126 Manage models in one place. (#2695) 2019-05-17 00:33:29 +08:00
吴晟 Wu Sheng 3c52a326cb
Miss copy response code in mesh analysis. (#2684) 2019-05-16 00:20:18 +08:00
彭勇升 pengys 63fb961c0d New OAP annotations, they are friendly for streaming loader. (#2670)
* New stream annotation.
- Inventory annotation example:
@Stream(name = ServiceInventory.INDEX_NAME, scopeId = DefaultScopeDefine.SERVICE_INVENTORY, storage = @Storage(builder = ServiceInventory.Builder.class, deleteHistory = false), kind = StreamKind.Inventory)

- Metrics annotation example:
@Stream(name = ServiceRelationClientSideMetrics.INDEX_NAME, scopeId = DefaultScopeDefine.SERVICE_RELATION, storage = @Storage(builder = ServiceRelationClientSideMetrics.Builder.class), kind = StreamKind.Metrics)

- Record annotation example:
@Stream(name = SegmentRecord.INDEX_NAME, scopeId = DefaultScopeDefine.SEGMENT, storage = @Storage(builder = SegmentRecord.Builder.class), kind = StreamKind.Record)

- TopN annotation example:
@Stream(name = TopNDatabaseStatement.INDEX_NAME, scopeId = DefaultScopeDefine.DATABASE_SLOW_STATEMENT, storage = @Storage(builder = TopNDatabaseStatement.Builder.class), kind = StreamKind.TopN)

* no message

* Stream annotation finish.

* Make stream processors to be the singleton class.

* Fixed the compile errors.

* Modify the OAL module for this annotation refactor.

* Add apache license header.

* Duplicate import.

* Fixed check style error.
2019-05-15 22:42:38 +08:00
于玉桔 1b6bd5f81d study sharding sphere (#2679) 2019-05-15 19:12:09 +08:00
Zhang Yonglun c7c1774ab1 Provide plugin for ShardingSphere (#1934)
* Provide plugin for ShardingSphere (#1933)
2019-05-15 17:56:39 +08:00
caoyixiong 91ffae2526 support Nacos cluster (#2640)
* Fix #2546

* Change the stackdepth type

* Fix bug

* Fix CI failed

* fix #2599

* fix ci

* add license

* add ActiveTag error methods

* fix

* fix

* nacos

* nacos

* nacos

* nacos

* fix ci

* support nacos cluster

* fix yml

* fix license

* fix ci

* remove optional

* update license

* update license and doc

* fix
2019-05-15 00:29:23 +08:00
caoyixiong b4ee1f17fb update dependencyManagement (#2660)
* Fix #2546

* Change the stackdepth type

* Fix bug

* Fix CI failed

* fix #2599

* fix ci

* add license

* add ActiveTag error methods

* fix

* fix

* fix doc

* update doc

* update dependencyManagement

* fix
2019-05-14 23:09:42 +08:00
彭勇升 pengys 118485fbb7 Make the elasticsearch json object build to be a public method. (#2648) 2019-05-10 12:43:17 +08:00
彭勇升 pengys 3a31812854 Recover the module name of envoy-metric. (#2645) 2019-05-10 12:02:17 +08:00
彭勇升 pengys ed78dabe8b Rename metric and indicator to metrics. (#2643)
* Rename metric to metrics.

* Fixed test case execute failure issues.
2019-05-10 08:05:37 +08:00
Ming Deng a4eb10d1da 1. Add unit tests for cluster-consul-plugin; (#2572)
2. Add unit tests for cluster-zookeeper-plugin;
3. Add unit tests for cluster-kubernetes-plugin;
2019-05-06 09:11:15 +08:00
Jared Tan 4da0f486b5
add prometheus. (#2580) 2019-05-05 15:52:40 +08:00
Michael Hausegger ac2cc7339d Added Unit Tests to increase code coverage (#2571) 2019-05-03 08:29:24 +08:00
吴晟 Wu Sheng 24393f3b8d Fix query all scope in MySQL and H2 storage. (#2568) 2019-05-01 00:39:29 +08:00
Ming Deng 4b19bd77cf add unit tests for alarm-plugin module (#2542) 2019-04-30 21:46:23 +08:00
吴晟 Wu Sheng 9b87086d72
Move to 6.2 (#2563)
* Move submodule plugin.

* Always auto-submodule

* [maven-release-plugin] prepare release v6.1.0

* [maven-release-plugin] prepare for next development iteration

* Change keys location.
2019-04-30 12:16:50 +08:00
吴晟 Wu Sheng 9901005995 Fix bug about match query in ElasticSearch storage. (#2550)
* Fix bug about match query.

* Update UI and alarm query

* Fix style

* Fix NPE.
2019-04-28 18:11:53 +08:00
康智冬 2dcf27b799 Update all "incubator-skywalking" to "skywalking" ,"incubator-servicecomb-java-chassis" to "servicecomb-java-chassis" correctly, and ".gitmodules" will update at #2531 (#2548) 2019-04-28 15:47:14 +08:00
Jared Tan 5b0419b7c2 support es query segment max size. (#2540)
* support es query span max size.

* refactoring segmentQueryMaxSize.

* fix

* fix
2019-04-26 23:39:40 +08:00
Ming Deng ec7dba3cab Add unit test for GRPCExporter and GRPCExporterProvider (#2498)
* Add unit test for GRPCExporter and GRPCExporterProvider

* MockLongValueIndicator impl the LongValueHolder and MockIntValueIndicator impl the IntValueHolder

* formate the code
2019-04-21 20:19:09 +08:00
Jared Tan 0b2e355b52 extend Metadata limit (#2492)
* fix default MetadataQuery Max size.

* revert mysql
2019-04-17 19:25:46 +08:00
Brandon Fergerson ce1c7aadfc Vert.x Core 3.x Plugin (#2386)
* vertx plugin impl
2019-04-16 23:46:49 +08:00
彭勇升 pengys 73e8853fa5 Provide elasticsearch template operation method. (#2474)
* Provide elasticsearch template operation method.

* Fixed compile failure issue.
2019-04-11 20:08:51 +08:00
彭勇升 pengys 4beaac001b Integration test for elastic search client. (#2464)
* Integration test for elastic search client.

* Just test verify command.

* CI command order change.

* Remove maven clean.

* no message

* Create Jenkinsfile to try the apache build for our CI.
2019-04-10 10:15:54 +08:00
吴晟 Wu Sheng 9ab568faf2
Support shutdown the trace analysis. (#2463) 2019-04-09 18:18:13 +08:00
吴晟 Wu Sheng df362b18f0
Query protocol and codebase for log type record (#2449)
* New query graphql protocol added.

* Finish a new metric, log(abstract) with HTTP Access Log.

* Submit the draft codes of logs.

* Remove @IDColumn

* Fix startup issue.

* Add http_access_log to disable list.

* Finish a wrong service implementation.

* Add trace id in log query condition and result.

* Fix style
2019-04-08 07:53:06 +08:00
Lemon c3cc3d2e56
Fix clr receiver (#2456) 2019-04-07 23:25:08 +08:00
吴晟 Wu Sheng ff6fb90d38
Add jaeger traces support (#2434)
* Make Jaeger receiver works in 12450 as default.

* Finish compile and codebase.

* Make codes runnable.

* Finish Jaeger query tests.

* Add document for jaeger receiver.

* Add readme.

* Fix a break link.

* Finish doc.
2019-04-01 20:52:59 -07:00
吴晟 Wu Sheng e59a488005
Setup Jaeger receiver and revert #2425 (#2431)
* Fix missing licenses in dist.

* Move all CoreRegisterLinker together into SharingReceiver.

* Setup receiver endpoint

* Revert "Provide create, delete, isExists template method by elastic client. (#2425)"

This reverts commit e6a7720f03.
2019-04-01 10:52:29 -07:00
吴晟 Wu Sheng 315c0e69ee
Reorganize the receiver proto (#2426)
* Move all receiver proto files together, in case the class conflict in gogoproto.

* Add jaeger proto and its dependency proto. Also license provided.

* Fix rat.
2019-03-30 18:25:31 -07:00
彭勇升 pengys e6a7720f03 Provide create, delete, isExists template method by elastic client. (#2425) 2019-03-30 13:19:10 -07:00
吴晟 Wu Sheng 601b472ef6 Support Backend acts as pure Zipkin collector (#2424)
* Codebase for zipkin span persistence.

* Fix missing fields in storage.

* Miss the latency field.

* Finish some tests.

* Fix wrong latency.

* Finish doc and reset application.yml

* Make the description more clear.
2019-03-31 01:36:36 +08:00
彭勇升 pengys 1fd5c5790a
Divide two static classes (#2411)
* 1. Remove static worker instances holder.
2. Remove static worker instance id generator.

* Fixed test case failure.
2019-03-30 15:37:19 +08:00
吴晟 Wu Sheng 59d4725091
Fix endpoint name rule package (#2405)
* Add more logs

* no message

* no message

* Exclude test file.
2019-03-26 13:25:07 -07:00
吴晟 Wu Sheng 9a09e96204 Support disable statement in OAL (#2402)
* Try to make disable work.

* Make disable works.

* Add disable document.
2019-03-26 23:34:31 +08:00
彭勇升 pengys a482eaf37f 1. Fixed the warning of 'parent.relativePath' points issue when running the mvn package command. (#2404)
2. Fixed the warning of duplicate declaration of plugin issue when running the mvn package command.
3. Fixed the warning of duplicate declaration of mysql connector jar when running the mvn package command, because of provided scope include test scope.
4. Fixed the warning of expression ${artifactId} is deprecated issue when running the mvn package command.
5. Fixed the warning of expression ${version} is deprecated issue when running the mvn package command.
2019-03-26 05:10:12 -07:00
吴晟 Wu Sheng 3acd044d25
Support endpoint group in mesh. (#2403)
* Support endpoint group in mesh.

* Fix CI.

* Refactor for reduce string compare.

* Support endpoint naming rule in service level
2019-03-25 21:02:35 -07:00
吴晟 Wu Sheng 0ecf641c17 Support gRPC metric exporter (#2395)
* Support grpc exporter.

* Support scope(all) metric export and finish document.

* Close exporter even in local debug env. And fix CI.

* Remove the system.out

* Fix absent 4.

* Support subscription from remote.

* Add the doc

* Update application.yml
2019-03-25 15:48:00 +08:00
彭勇升 pengys f38aea3d97 Fixed a logical error cause JVM metrics not dispatched. (#2398) 2019-03-23 08:40:35 -07:00
吴晟 Wu Sheng cea04f3ca0 Wrong host name. (#2397) 2019-03-22 19:55:02 -07:00
吴晟 Wu Sheng 975a06d163 Add catalog to ScopeDeclaration annotation. Make the alarm adapt to it. Now more metric could go through alarm, such as JVM, CLR. (#2391) 2019-03-21 18:38:32 +08:00
Ahoo Wang 3438151693 Sync SmartSql provider setting to all of component-libraries.yml (#2394)
* Add SmartSql provider components in component-libraries config

* sync SmartSql provider setting -> fix https://github.com/apache/incubator-skywalking/issues/2390
2019-03-20 23:06:13 -07:00
kl c69eafefad Added elasticsearch warehouse certification support (#2384)
* Added elasticsearch warehouse certification support

* Add the elasticsearch service for Http Basic instructions

* Update backend-storage.md

Change document.
2019-03-20 21:09:29 -07:00
彭勇升 pengys 7419a59125 Supplement unexpected exception message. (#2389) 2019-03-20 18:02:16 -07:00
Lemon 7047c97e8b Add CLR_Receiver plugin (#2385) 2019-03-20 20:53:42 +08:00
Ahoo Wang 6aefdc4277 Add SmartSql provider components in component-libraries config (#2387) 2019-03-20 18:08:49 +08:00
Lemon 9b055cc5d4 Update proto commit (#2383) 2019-03-19 20:37:19 +08:00
Xin,Zhang 9a1518a652
Merge branch 'master' into qualified-spring-mvc-endpoints 2019-03-17 22:27:52 +08:00
peng-yongsheng 923e47206e Fixed failures with test cases 2019-03-17 10:19:26 +08:00
Xin,Zhang 5ef9adc8b8
Merge branch 'master' into qualified-spring-mvc-endpoints 2019-03-17 07:24:00 +08:00
peng-yongsheng 610a53784f fixed expressions error. 2019-03-17 00:21:20 +08:00
peng-yongsheng 940130e24a Added 4 expressions in OAL syntax: >, <, >=, <= 2019-03-17 00:15:51 +08:00
吴晟 Wu Sheng a3a85e520e Support Exporter in core (#2368)
* Rename ALarmSupported to WithMetadata

* Finish the base of exporter.

* Fix class comment.
2019-03-16 23:27:15 +08:00
kezhenxu94 05b0498fed extract immutable object to reduce garbages (#2364) 2019-03-15 14:03:30 +08:00
Brandon Fergerson a2df0e0e3d didn't mean to commit with this PR 2019-03-12 23:00:06 -06:00
Brandon Fergerson e471b1077a
Merge branch 'master' into qualified-spring-mvc-endpoints 2019-03-12 22:55:12 -06:00
彭勇升 pengys 70e6c203ab Shutdown the OAP server when catch any exception. (#2352) 2019-03-12 22:52:38 +08:00
吴晟 Wu Sheng 0951b9434b Make k8s-Coordinator works in role mode. (#2347)
* Make k8s-Coordinator back in role mode.

* Start query API server after the core started.

* Do lock when port has been intialized.

* Rename service.

* Fix text cases.

* Declare ConfigService.class in core module.

* Implement in an easier way.

* Envoy print whole metric, now in debug.

* Forcedly fix envoy timestamp issue.
2019-03-12 15:36:36 +07:00
Brandon Fergerson 68376fb505 vertx plugin work 2019-03-11 22:14:19 -06:00
Jared Tan eb19715f99 set es storage namespace to lower case. (#2348) 2019-03-12 07:17:00 +08:00
彭勇升 pengys ab398f79c9 The role of OAP server. (#2344)
* The role of OAP server.
Mixed: Receive agent data, level 1 aggregate, level 2 aggregate
Receiver: Receive agent data, level 1 aggregate
Aggregator: level 2 aggregate

* Mistake, stadalone default.

* Update application.yml
2019-03-11 16:34:30 +08:00
彭勇升 pengys 6d00642386 Separation the remote gRPC server from the receiver gRPC server. (#2335)
* #2327

Add a new module for share receiver server or to be a bridge of core server.

* Rename the module name.
2019-03-11 14:23:57 +08:00
吴晟 Wu Sheng 7c726905c3 If the node has no interaction, then it disappear in topology. (#2336) 2019-03-10 22:10:20 +08:00
吴晟 Wu Sheng 93347b2340
Envoy heartbeat update bug (#2334) 2019-03-08 17:41:26 +08:00
吴晟 Wu Sheng c2a7e8e539
Bug fix. (#2333) 2019-03-08 16:31:42 +08:00
吴晟 Wu Sheng b4cb7e0bca
Envoy metric support and a bug fix (#2321)
* Extend envoy metric service, scope and OAL lexer/parser.

* Finish metric extension and oal.

* Make test env works.

* Finish test of envoy connection and memory metric.

* Change document.

* Finish docker compose test.
2019-03-07 17:05:46 +08:00
Gao Hongtao 5629bc33f3 Update RegisterPersistentWorker.java (#2307)
Fixed wrong parameter
2019-03-02 14:52:22 +08:00
Lemon 4a54c7687d Add clr metrics scope and oal script (#2297)
* Add CLR metric scope and oal_script

* Add max indicator

* Fix checkstyle
2019-03-02 09:36:48 +08:00
Dhi Aurrahman b8a414edf5 Envoy metrics receiver plugin protos (#2304)
* Add envoy metrics service protos

This patch imports protos from envoyproxy/data-plane-api and
prometheus/client_model to enable metrics service service feature in
SkyWalking OAP.

Signed-off-by: Dhi Aurrahman <dio@tetrate.io>

* Add Envoy related docs

Signed-off-by: Dhi Aurrahman <dio@tetrate.io>

* Update the LICENSE to include new protos license

From:
- envoyproxy/data-plane-api
- prometheus/client_model

Signed-off-by: Dhi Aurrahman <dio@tetrate.io>

* Add a complete config.yaml example

Signed-off-by: Dhi Aurrahman <dio@tetrate.io>

* Add note on Envoy dynamic config

Signed-off-by: Dhi Aurrahman <dio@tetrate.io>

* Add protoc-gen-validate license

Signed-off-by: Dhi Aurrahman <dio@tetrate.io>

* Add samples

Signed-off-by: Dhi Aurrahman <dio@tetrate.io>

* Make CI and license right.

* Update README.md

@dhi typo :P

* Update README.md

Another typo :P

* Delete metrics.json

metrics.json is included in identify.json and not be linked in document.
2019-03-01 22:13:59 +08:00
吴晟 Wu Sheng fb62025da8
Improve OAP extendibility (#2288)
* Make scope meta configurable.

* Fix test cases in ci.

* Change step 1

* Refactor step 2

* Other compile issue done. Prepare the generator changes.

* Revert some wrong changes to Istio receiver.

* Step 3, make compile pass.

* Try to make CI passed.

* Add a check.

* Fix generated code style

* Provide new and extendable dispatcher generator tool

* Fix startup.

* Can't guarantee the dispatchers are always existing. Put explicit comments at there to avoid confusion, since this is different with old version.

* Fix a H2 query for endpoint search.

* Fix a wrong mysql alarm query.

* Provide new document and `generate-tool-grammer` module.

* Add missing last section of document.

* Fix typo

* Relocate the @ScopeDeclaration annotation, make it more sense. Also remove the useless @SourceType annotation. And adjust document for these changes

* ScopeDeclaration can be used once for each class only, now.
2019-02-26 13:43:14 +08:00
Jared Tan c596d0ac82 add serviceInstanceId in Segment storage. (#2146)
* add serviceInstanceId in Segment storage.

* add serviceInstanceId in query condition.
2019-02-23 07:59:19 +08:00
LazyLei 8bacabf741 fix typo (#2274) 2019-02-22 07:32:36 +08:00
吴晟 Wu Sheng 58cf5936e6 Improve OAP cluster performance (#2271)
* Refactor for cluster mode.

* Make send to L2 in certain cycle.
2019-02-21 16:33:07 +08:00
吴晟 Wu Sheng c019535ee9
Fix mesh telemetry performance issue and adjust default thread number (#2261)
* Try adjustment.

* Remove heartbeat.

* Make heartbeat back to work. And default threadpool size more sense.

* Make L2 to less than before.

* Make instance heartbeat works.

* Try L1 aggregation thread = core * 2 * 2.
2019-02-20 08:29:17 +08:00
吴晟 Wu Sheng 479ee33244
Correct trace id in slow db statement (#2254)
* Correct trace id.

* Fix match.

* Add cover token to retry.

* Retry new test plugin.

* Reset to jacoco.

* Update jacoco version.
2019-02-19 13:02:54 +08:00
吴晟 Wu Sheng 333bcd48e0
Provide slow database rule document. (#2253) 2019-02-18 21:23:36 +08:00
吴晟 Wu Sheng 2f3ccf368c
Backend streaming thread model improvement (#2247)
[Performance Improvement]Backend streaming thread model improvement
2019-02-18 14:55:07 +08:00
于玉桔 0929ff3453 Support Zookeeper plugin (#2211)
* Zookeeper plugin
2019-02-15 22:13:44 +08:00
吴晟 Wu Sheng b86426c9a2 Add consumer pool to Datacarrier (#2245)
* Extend consume pool to data carrier.

* Change indicator aggregate worker and persistent worker to use default consumer pool.

* Fix CI.
2019-02-13 23:19:47 +08:00
吴晟 Wu Sheng 4c6429061a Support to register different host/port at cluster coordinator (#2244)
* Support to register different host/port at cluster coordinator. Only for Zookeeper and Consul

* Provide document for internalComHost and internalComPort

* Reset port to default.
2019-02-13 16:06:43 +08:00
吴晟 Wu Sheng 4babd6ff73 Support Top sql (#2239)
* The prototype of topN sql worker.

* Add scope and new manual dispatcher.

* no message

* Finish topN persistence codes. Not test yet. And query have not added.

* Finish the top n database statement persistent.

* Support different slow thresholds for different db types.

* Fix wrong db default threshold

* Finish new query protocol binding.

* Provide query empty implementation and sync ui.

* Finish all codes, hope it works :P
I will run the tests tonight.

* Fix

* Fix

* Fix a startup issue.

* Add time bucket to persistent.

* Fix wrong query result column name.

* Fix Database query.

* Fix checkstyle.

* Fix wrong order logic, and add a test case to verify, to fix https://github.com/apache/incubator-skywalking/pull/2239#discussion_r255948249
2019-02-12 23:13:02 +08:00
Lemon f7ca26729d Database metrics provided. (#2025)
* Add Database source

* Add DatabaseSource source and database_* script for oal

* Enable Database_Indicator

* Add file license

* Rename DatabaseService to ClientDatabase. In the future, we may have real database server monitoring.

* Add query database from H2

* refactor

* update submodule

* refactor

* Fix style

* Fix: unknown tag error

* fix checkstyle
2019-01-27 08:27:34 +08:00
于玉桔 a36394d9bc Support lettuce plugin (#2152)
* Support lettuce plugin

* lettuce plugin bugfix

* lettuce plugin fix license issue

* lettuce plugin fix cluster and config issue

* plugin lettuce compatible with low 5.0.x version

* lettuce plugin support version accurately describes on Supported-list.md

* plugin lettuce compatible with low 5.0.2 version

* lettuce plugin fix wrong batch method intercept point

* move lettuce to optional plugins

* fix ci issue

* fix ci issue

* Modify the description file

* Pom code optimization

* Optimization operation name

* Optimization operation name2
2019-01-26 13:09:03 +08:00
吴晟 Wu Sheng 2e0104e599 Register lock refactor (#2195)
* Refactor register and reduce the lock time.

* Refactor es id generation mechanism.

* Wrong commit place.
2019-01-23 23:21:36 +08:00
c704ee0f68 for issue#2196 (#2197)
for issue#2196
2019-01-23 18:55:38 +08:00
彭勇升 pengys 9810c5e308 Improve buffer reader speed. (#2188)
* 1. Sleep 500 milliseconds after a batch re-call finish.
2. Re-create register lock index when the system property named debug is setting.
3. Get the register inventory before lock to avoid increment the sequence but not use.
4. Return the exchange flag after all the references and spans in one segment parsed to reduce the number of segment parse.
5. Put the not exchanged segment into a collection then try to exchange no more than 10 times because of the exchange is asynchronous.
6. Cache the segment object to avoid repeated deserialization.

#2185

* #2185
1. Sleep 500 milliseconds after a batch re-call finish.
2. Re-create register lock index when the system property named debug is setting.
3. Get the register inventory before lock to avoid increment the sequence but not use.
2019-01-21 04:21:45 +08:00
吴晟 Wu Sheng d3155220c3
Fix H2 and MySQL endpoint dependency map miss upstream side and add changelogs (#2187)
* fix no language attr value in mesh (#2182)

* Fixed the inventory register lock invalid bug. (#2184)

* #2183

Merge commit into master.

* Make the h2 register lock same as mysql.

* Fix #2186
2019-01-20 18:14:18 +08:00
彭勇升 pengys 33f5cc19b5 Fixed the inventory register lock invalid bug. (#2184)
* #2183

Merge commit into master.

* Make the h2 register lock same as mysql.
2019-01-20 16:41:06 +08:00
Gao Hongtao 334dd03429 fix no language attr value in mesh (#2182) 2019-01-19 10:48:54 +08:00
吴晟 Wu Sheng 5a7eb5656a
GA tagged, move to 6.1 (#2180)
* [maven-release-plugin] prepare release v6.0.0-GA

* [maven-release-plugin] prepare for next development iteration
2019-01-18 20:04:23 +08:00
吴晟 Wu Sheng 18ed80bd95
Fix missing language field. (#2174) 2019-01-18 08:00:51 +08:00
吴晟 Wu Sheng 9cda28f054
Set H2 storage startup right. (#2173) 2019-01-18 00:14:04 +08:00
a198720 b1b5ee5103 fixed the index name to format name in logs (#2165)
* fixed  the index name to format name in logs

* modify the log level from info to debug
2019-01-16 16:34:59 +08:00
a3e03f6133 Un-exchanged endpoint name in ref can't find the id (#2162)
* Update ReferenceIdExchanger.java

Change comments of codes.
2019-01-15 20:38:05 +08:00
吴晟 Wu Sheng b5eb9e304d Support Service Instance Inventory properties and bug fixed (#2156)
* Refactor service instance inventory to properties based entity.

* Fix a bug and refactor properties update.
2019-01-13 22:07:52 +08:00
Jared Tan 84a5c8c546
fix log output. (#2153) 2019-01-12 21:42:52 +08:00
Yann.Xia f9fb69336e Fix unessential gson instance (#2151) 2019-01-12 12:01:11 +08:00
于玉桔 43b216aa92 Support redisson plugin (#2083)
* plugin support redisson
2019-01-11 22:32:09 +08:00
吴晟 Wu Sheng 9cc5e76d97
Support service inventory extension fields in json format (#2148)
* Add properties for service inventory

* Fix code bugs

* Provide develop doc for inventory extension.
2019-01-11 21:24:51 +08:00
于玉桔 20aa7f9ba1 Bugfix: logger information has not enough arguments (#2147) 2019-01-11 20:00:23 +08:00
吴晟 Wu Sheng 5f57e561c7 Provide grafana settings for telemetry (#2138)
* Change a label name for  sw instance to avoid confict.

* Fix a wrong metric name.

* Fix too many counter instances.

* Set uptime to second.

* Fix format.

* Fix format

* Remove two unnecessary counter.

* Provide grafana dashboard settings and remove unnecessary metric.

* Provide a simple UI brief doc. Fix #2137
2019-01-10 07:27:23 +08:00
吴晟 Wu Sheng 6499d4f583
Implement Prometheus to oap backend telemetry (#2133)
* Finish the basic codes of telemetry.

* Add many telemetry in oap.

* Fix a test case.

* Finish all telemetry metric.

* Fix format.

* Make telemetry works.

* Support JVM metrics.

* Add doc for telemetry.

* Fix typo.

* Fix #2135
2019-01-08 23:20:13 +08:00
吴晟 Wu Sheng aaa403ec00
Set telemetry module and APIs (#2123)
* Finish the APIs of telemetry module.

* Add prometheus license.

* Active default telemetry provider.
2019-01-07 09:48:53 +08:00
langyan1022 6a4e7ffc6c fix missing ojdbc component id in component-libraries.yml (#2122)
* add ojdbc component id
2019-01-04 20:56:38 +08:00
XiaoFu ee6841fc13 Support Gson Plugin (#2090)
* Support Gson plugin
2019-01-03 23:51:22 +08:00
吴晟 Wu Sheng 0a3af743b4
Fix wrong alarm text. (#2120) 2019-01-03 23:13:52 +08:00
吴晟 Wu Sheng ec391becad
Provide two start up modes and documents. (#2116) 2019-01-03 15:19:45 +08:00
吴晟 Wu Sheng 95214aecf3
update version for next iteration. (#2084) 2018-12-23 09:14:14 +08:00
吴晟 Wu Sheng c592aea8db Refactor register API for making integration easier. (#2075)
* Refactor register API for making integration easier.

* Fix wrong refactor.
2018-12-21 22:32:06 +08:00
XiaoFu addf5101e0 Support canal plugin (#2035)
* fix add Canal plugin

* fix add UnitTest

* fix   format pom.xml

* Delete CanalApplication.java

* fix support cluster url

* fix add Licensed

* fix bug

* fix
2018-12-20 21:07:31 +08:00
吴晟 Wu Sheng c7884694da
Move node type from network address to service level[Need storage module update] (#2051)
* Change srcLayer to nodeType. Add nodeType in service inventory entity.

* NodeType value refactor.

* Format codes.

* Fix compile issue.

* Fix bugs, and make query on service inventory instead of network inventory
2018-12-17 09:05:16 -08:00
ZhHong 0284293458 /instance/register osName, hostName (#2042)
osName and hostName values are reversed。
2018-12-13 07:58:02 -08:00
Jared Tan 2f37158e41
modify code style (#2041)
* modify code style

* ci
2018-12-13 21:59:17 +08:00
彭勇升 pengys dfe2b08599 [OAP Server][Cluster Plugin] Provide consul cluster plugin (#2036)
* Provide consul cluster plugin.

* Change log and application config file.

* Add consul's config item into the docker's application.yml.

* Fixed bug.

* Add consul description into  readme.

* Add okhttp component license.
2018-12-12 08:14:41 -08:00
彭勇升 pengys 7532583d90 Endpoint name need fuzzy query. (#2026) 2018-12-09 13:01:58 +08:00
彭勇升 pengys c12cfa5816 No need to dependency to elasticsearch. (#2024) 2018-12-09 11:27:16 +08:00
XiaoFu 45f44544eb Support rabbitmq plugin (#2000)
* Fix support rabbitmq plugin

* fix Unit test rename sw3 to sw6

* Update pom.xml

* fix adjust rabbitmq Unit test

* fix add rabbitmq component in docker component-libraries.yml

* Update RabbitMQProducerInterceptor.java

* Update RabbitMQProducerInterceptor.java
2018-12-07 21:20:10 +08:00