Commit Graph

1064 Commits

Author SHA1 Message Date
dashanji bb8f6d2e21
fix agent.config (#28) 2021-09-20 09:14:00 +08:00
业余布道师 26f1d986a2
Add plugin for Alibaba Druid connection pool. (#27) 2021-09-19 22:52:32 +08:00
Jiajing LU a7a74a4067
Chore: Add benchmark and improve docs for exception-ignore plugin (#25)
* add benchmark and improve docs

Signed-off-by: Megrez Lu <lujiajing1126@gmail.com>

* modify changelog and copy benchmark results to the docs
2021-09-14 16:38:54 +08:00
吴晟 Wu Sheng a27cf2af71
Fix doc format issue. (#24) 2021-09-13 21:15:33 +08:00
吴晟 Wu Sheng 9c206bea5c
Add compiling doc (#23) 2021-09-13 18:14:36 +08:00
kezhenxu94 61892085f9
Migrate base Docker image from JDK to JRE and remove unused classes (#21) 2021-09-09 12:51:25 +08:00
Daming dd0d8afe88
Support mTLS for gRPC channel (#15) 2021-08-31 15:56:30 +08:00
吴晟 Wu Sheng d47f9cc370
Fix change log link (#13) 2021-08-29 16:40:25 +08:00
吴晟 Wu Sheng 5b7cf51f43
Set up release process and make release doc ready. (#11)
* Set up release process and make release doc ready.

* Fix missing license files.

* Fix link check skip rules.

* Add a new pattern.
2021-08-27 18:11:57 +08:00
吴晟 Wu Sheng be8e88332d
Fix break menu link (#9) 2021-08-27 15:07:22 +08:00
Juntao Zhang 7770a86887
Update menu.yml (#8) 2021-08-27 13:29:26 +08:00
吴晟 Wu Sheng 428220b203
Create README.md (#6) 2021-08-27 11:31:25 +08:00
吴晟 Wu Sheng fc79937619
Doc polish, remove unrelated documents and fix source code LICENSE (#5) 2021-08-27 10:08:36 +08:00
kezhenxu94 157e146953
Fix dead link (#7575) 2021-08-26 15:37:10 +08:00
kezhenxu94 944b47b515
Fix dead link (#7560) 2021-08-25 14:21:43 +08:00
Wing c778007c02
refine backend doc (#7559) 2021-08-25 14:17:08 +08:00
吴晟 Wu Sheng db2bc93573
Separate agent docs to avoid long single page. (#7537) 2021-08-23 20:10:01 +08:00
Daming a2e011f9b0
Kafka extra producer configuration enhancement (#7526) 2021-08-23 17:16:19 +08:00
Wing 8f7d16a18e
Refine backend doc (#1) (#7522)
* Refine dynamic-config.md

* Refine dynamical-logging.md

* Refine endpoint-grouping-rules.md
2021-08-21 14:00:26 +08:00
kezhenxu94 1af2e46e33
Add a new API to test log analysis language (#7475) 2021-08-18 16:40:25 +08:00
kezhenxu94 6bb4d35ce8
Add all agent config to `agent.conf` file for convenient containerization use cases (#7470)
* Add all agent config to `agent.conf` file for convenient containerization use cases

* Fix name and default value
2021-08-18 10:25:28 +08:00
王旺 77bf5de7f6
Polish otel receiver doc (#7464)
* modify receiver and vm-monitoring doc

* Polish the doc.

* Add changelog.

Co-authored-by: wang <wang@163.com>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2021-08-16 11:31:15 +08:00
hailin0 ce45397c56
Fix kafka-reporter-plugin shade package conflict (#7463)
* Fix kafka-reporter-plugin shade package conflict

Don't shade lz4, snappy or zstd package because they call native library files.
2021-08-15 21:55:45 +08:00
wallezhang 4b66f1e0a7
fix: Fix MultiScopesAnalysisListener#setPublicAttrs log warn frequently (#7271)
* fix: Fix MultiScopesAnalysisListener#setPublicAttrs log warn frequently. #6562

1. Rename current STATUS_CODE to HTTP_RESPONSE_STATUS_CODE, real tag key should be http.status_code.
2. Add a new string tag RPC_RESPONSE_STATUS_CODE to hold all string type value tag. The key is `rpc.status_code`.
3. At the backend, keep responseCode for HTTP_RESPONSE_STATUS_CODE tag, but add @Deprecated. Also, add httpResponseStatusCode(a duplicate of responseCode) and rpcStatusCode(for RPC_RESPONSE_STATUS_CODE) fields for OAL.

* Modify `Tags.STATUS_CODE` field name to `Tags.HTTP_RESPONSE_STATUS_CODE` and type from `StringTag` to `IntegerTag`, add `Tags.RPC_RESPONSE_STATUS_CODE` field to hold rpc response code value.

* Add `rpcStatusCode` for `rpc.status_code` tag in the OAL objects. The `responseCode` field is marked as deprecated and replaced by `httpResponseStatusCode` field. 

* Tag `status_code` is still supported in the backend for forward compatbility. Will be removed one year later.

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2021-08-14 20:17:46 +08:00
Wing cf08a2da37
refine backend doc (#7451) 2021-08-13 21:06:17 +08:00
吴晟 Wu Sheng de6cae3429
[Break Change] Remove endpoint name in the trace query condition. (#7438)
* [Break Change] Remove endpoint name in the trace query condition.

* Fix a local UT error(MacOS only)
2021-08-11 16:27:10 +08:00
Yihao Chen ac4330c0bc
Add a doc section for Python agent log reporter. (#7430) 2021-08-10 15:39:09 +08:00
wankai123 4e7d80fb88
Support Metric level function `serviceRelation` in `MAL` and binding envoy metrics into the topology. (#7399)
* Support Metric level function `serviceRelation` in `MAL`.
* Support envoy metrics binding into the topology.
* add istio args
* remove istio 1.7

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: Jared Tan <jian.tan@daocloud.io>
Co-authored-by: Zhenxu <kezhenxu94@apache.org>
2021-08-06 17:09:13 +08:00
Daming 9ecb9fd87c
add event http receiver (#7406) 2021-08-04 15:53:48 +08:00
Gao Hongtao 1f28d2036a
Add logging module to load log configuration dynamically (#7377)
* Add logging module to load log configuration dynamically

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>
2021-07-29 19:55:22 +08:00
kezhenxu94 65e8ab3ecc
Log rate limit sampler rename `qps` to `rpm` (#7384) 2021-07-29 18:11:07 +08:00
pkxiuluo ffc69dc6f3
ES storage support set order of index template. (#7378) 2021-07-27 20:13:31 +08:00
Jared Tan 90de9f9515
add sending Envoy Metrics to OAP example within envoy 1.19 and bump up to Envoy V3 api. (#7366)
* bump up envoy metrics service sinks version. and update envoy.yaml config for demo.
2021-07-23 22:59:51 +08:00
吴伟杰 da9426dd6e
Upgrade agent plugin for ElasticJob 3.0.0 GA version (#7345)
* Upgrade agent plugin for ElasticJob 3.0.0 GA version.

* Remove 3.0.0 alpha support.
2021-07-22 15:30:00 +08:00
wankai123 a1c53bb866
doc: Add Self Observability service discovery (k8s) (#7339) 2021-07-20 18:02:51 +08:00
kezhenxu94 902b6c540b
Fix dead links (#7338) 2021-07-20 08:54:05 +08:00
Cool-Coding 467a95b61d
Fix the problem of -meters metrics topic isn't created with namespace prefix (#7325) (#7330) 2021-07-19 14:58:24 +08:00
吴伟杰 06e589fab0
Remove plugins for ShardingSphere legacy and unstable versions (#7323)
Remove the following plugins due to they are legacy and unstable releases.
1. sharding-jdbc-1.5.x-plugin
2. sharding-sphere-4.x-rc3-plugin
3. sharding-sphere-4.x-plugin (This is for RC1 and RC2)

To people who want to use these removing versions, you still could copy the plugins from SkyWalking's 8.6.0 release to the '/plugins' folder to activate, unless SkyWalking has some core level APIs upgrade. This is very rare to happen.
2021-07-18 20:35:54 +08:00
吴晟 Wu Sheng a6afcac86e
Logically revert #6642 and partial #7153 to reduce unnecessary thread and concurrency process (#7318)
The key logic behinds all these is, metrics persistence is fully asynchronous.

* The core/maxSyncOperationNum setting(added in 8.5.0) is removed due to metrics persistence is fully asynchronous.
* The core/syncThreads setting(added in 8.5.0) is removed due to metrics persistence is fully asynchronous.
* Optimization: Concurrency mode of execution stage for metrics is removed(added in 8.5.0). The only concurrency of prepare stage is meaningful and kept.
* Remove the outside preparedRequest list initialization, worker instance could always build a suitable size list in the first place (Reduce Array.copy and GC load a little).
2021-07-17 16:03:50 +08:00
wankai123 9f3ff517d1
Support envoy cluster manager metrics (#7294) 2021-07-16 15:35:48 +08:00
吴晟 Wu Sheng 8df362b929
Adjust ElasticSearch index refresh period as INT(flushInterval * 2/3) (#7310)
Adjust index refresh period as INT(flushInterval * 2/3), it used to be as same as bulk flush period. At the edge case, in low traffic(traffic < bulkActions in the whole period), there is a possible case, 2 period bulks are included in one index refresh rebuild operation, which could cause version conflicts. And this case can't be fixed through core/persistentPeriod as the bulk fresh is not controlled by the persistent timer anymore.

This PR should avoid the following exception in the low load case, especially when bulkActions is set larger than the number of a metric type.
2021-07-16 12:10:35 +08:00
wankai123 2870b222b4
doc: separate infra monitoring doc to vm and k8s (#7301) 2021-07-15 10:23:49 +08:00
吴晟 Wu Sheng de975c7e2b
Remove synchronous persistence mechanism in API level and ElasticSearch implementation (#7293)
* Performance: remove the synchronous persistence mechanism from batch ElasticSearch DAO. Because the current enhanced persistent session mechanism, don't require the data queryable immediately after the insert and update anymore.
* Performance: share `flushInterval` setting for both metrics and record data, due to `synchronous persistence mechanism` removed. Record flush interval used to be hardcoded as 10s.
* Remove `syncBulkActions` in ElasticSearch storage option.
* Increase the default bulkActions(env, SW_STORAGE_ES_BULK_ACTIONS) to 5000(from 1000).
* Increase the flush interval of ElasticSearch indices to 15s(from 10s)

Add these 2 references. According to these, **(same _index, _type and _id) in same bulk will be in order**
1. https://github.com/elastic/elasticsearch/issues/50199
2. https://discuss.elastic.co/t/order-of--bulk-request-operations/98124

Notice, the order of different bulks is not guaranteed by the ElasticSearch cluster. We are going to have the risk of dirty write. But consider we set over 20s period between flush, and index flush period is 10, we should be safe.

Recommend 5000 bulk size and 15s flush interval only. The persistent period has been set to 25s.
2021-07-14 17:19:49 +08:00
whl12345 9e022d1a73
Provide plugin for Guava Cache (#7235) 2021-07-08 11:58:09 +08:00
Switch 4067fba2ab
Add some new thread metric and class metric to JVMMetric (#7230) (#7243) 2021-07-07 16:30:55 +08:00
Sergi Castro d15b67bd97
Allow configuring max request header size (#7249)
* Allow configuring max request header size

This allows configuring the HTTP max request header size from the jetty
server.
By default it uses 8192, the same jetty default.
2021-07-06 15:10:15 +08:00
Daming 5dd56a5ca4
Upgrade etcd cluster coordinator and dynamic configuration to v3.x (#7215) 2021-07-05 11:23:11 +08:00
Jared Tan 0efc733901
Replace zuul proxy with spring cloud gateway 2.x. in webapp module. (#7220) 2021-07-04 10:24:56 +08:00
mrproliu 156678a8bf
Move ehcache-2.x plugin as optional (#7236) 2021-07-03 16:56:05 +08:00
liqiangz 0f62d9289f
Add agent plugin to support Sentinel (#7190) 2021-07-03 00:20:14 +08:00