Commit Graph

278 Commits

Author SHA1 Message Date
kezhenxu94 ad0042f6f5
Add missing property set for new field `httpResponseStatusCode` (#7486)
Follow up https://github.com/apache/skywalking/pull/7271
2021-08-19 06:12:05 +08:00
wallezhang 4b66f1e0a7
fix: Fix MultiScopesAnalysisListener#setPublicAttrs log warn frequently (#7271)
* fix: Fix MultiScopesAnalysisListener#setPublicAttrs log warn frequently. #6562

1. Rename current STATUS_CODE to HTTP_RESPONSE_STATUS_CODE, real tag key should be http.status_code.
2. Add a new string tag RPC_RESPONSE_STATUS_CODE to hold all string type value tag. The key is `rpc.status_code`.
3. At the backend, keep responseCode for HTTP_RESPONSE_STATUS_CODE tag, but add @Deprecated. Also, add httpResponseStatusCode(a duplicate of responseCode) and rpcStatusCode(for RPC_RESPONSE_STATUS_CODE) fields for OAL.

* Modify `Tags.STATUS_CODE` field name to `Tags.HTTP_RESPONSE_STATUS_CODE` and type from `StringTag` to `IntegerTag`, add `Tags.RPC_RESPONSE_STATUS_CODE` field to hold rpc response code value.

* Add `rpcStatusCode` for `rpc.status_code` tag in the OAL objects. The `responseCode` field is marked as deprecated and replaced by `httpResponseStatusCode` field. 

* Tag `status_code` is still supported in the backend for forward compatbility. Will be removed one year later.

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2021-08-14 20:17:46 +08:00
吴晟 Wu Sheng 6a241aed75
[Break Change] Remove endpoint name in backend log and browser log query (#7444)
* Remove page path in the browser log query condition.

* Remove endpoint name in the backend log query condition.
2021-08-12 09:44:19 +08:00
wankai123 4e7d80fb88
Support Metric level function `serviceRelation` in `MAL` and binding envoy metrics into the topology. (#7399)
* Support Metric level function `serviceRelation` in `MAL`.
* Support envoy metrics binding into the topology.
* add istio args
* remove istio 1.7

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: Jared Tan <jian.tan@daocloud.io>
Co-authored-by: Zhenxu <kezhenxu94@apache.org>
2021-08-06 17:09:13 +08:00
Daming 9ecb9fd87c
add event http receiver (#7406) 2021-08-04 15:53:48 +08:00
吴晟 Wu Sheng 1c5e22a7be
Begin 8.8.0 iteration (#7395)
* [maven-release-plugin] prepare release v8.7.0

* [maven-release-plugin] prepare for next development iteration
2021-07-30 23:01:09 +08:00
wankai123 9f3ff517d1
Support envoy cluster manager metrics (#7294) 2021-07-16 15:35:48 +08:00
kezhenxu94 982001c63a
perf: optimize Envoy access log persistence performance (#7290) 2021-07-13 18:44:52 +08:00
kezhenxu94 b5eb1572eb
chore: clean up source-dependencies' licenses (#7277) 2021-07-10 11:55:20 +08:00
Sergi Castro d15b67bd97
Allow configuring max request header size (#7249)
* Allow configuring max request header size

This allows configuring the HTTP max request header size from the jetty
server.
By default it uses 8192, the same jetty default.
2021-07-06 15:10:15 +08:00
kezhenxu94 de1d0461cc
perf: trim useless metadata fields in ALS to improve performance (#7191)
These fields in `stateMap` metadata are not used by `metadata-service-mapping.yaml` now and there is low possibility that they may be used in real case, but, they cost a lot to deserialize, so we remove them to improve performance

From what I've tested, the analyzer can process 250k ALS logs before trimming the fields and can process 420k ALS logs after trimming the fields
2021-06-28 22:18:14 +08:00
liqiangz d63f3ffcc1
revert #7091 (#7189) 2021-06-28 21:05:28 +08:00
kezhenxu94 e7bc81abbb
Perf: optimize Envoy ALS analyzer performance in high traffic load scenario (reduce ~1cpu in ~10k RPS) (#7182) 2021-06-27 17:56:59 +08:00
kezhenxu94 3536b3c1c4
Extract dependency management to a bom (#7136) 2021-06-20 20:57:26 +08:00
kezhenxu94 528ee6de40
OAL supports generating metrics from events (#7134)
* OAL supports generating metrics from events

* Add new dashboard for event metrics

* Add some docs for event metrics
2021-06-19 20:20:37 +08:00
Zhenxu efcb396f73
Only count 5xx as error in Envoy ALS receiver (#7111) 2021-06-12 07:09:48 +08:00
liqiangz 7a3355f956
Use MAL to calculate JVM metrics, remove OAL dependency. (#7091) 2021-06-11 22:21:10 +08:00
吴晟 Wu Sheng 5eb1021639
Initialize 8.7.0 iteration (#7078) 2021-06-08 07:41:09 +08:00
Zhenxu 56f2e86a07
CVE: upgrade snakeyaml to prevent billion laughs attack in dynamic configuration. (#7071) 2021-06-05 14:41:46 +08:00
Rei Shimizu 3c4f2af158
change log REST endpoint with v3 prefixed (#7062) 2021-06-03 15:56:49 +08:00
wankai123 3034963374
Fix Jetty HTTP `TRACE` issue, disable HTTP methods except `POST`. (#7052) 2021-06-01 16:37:56 +08:00
Zhenxu bd38ec492e
Add HTTP implementation of logs reporting protocol (#7038) 2021-05-30 22:35:55 +08:00
Zhenxu Ke 379c4e1a46
Allow multiple definitions as fallback in `k8sServiceNameRule`. (#7006) 2021-05-25 17:33:07 +08:00
Zhenxu Ke 85a993faf5
Allow multiple definitions as fallback in metadata-service-mapping.yaml file (#6933) 2021-05-13 06:53:05 +08:00
Zhenxu Ke 94adbf1c1f
Bump Kubernetes client-java version (#6920) 2021-05-10 05:07:09 +08:00
Zhenxu Ke 4103551092
bugfix: Envoy error logs are not persisted when no metrics are generated (#6911) 2021-05-07 23:25:20 +08:00
Zhenxu Ke 3b15f8d132
feature: Envoy access log receiver supports TCP logs (#6727) 2021-05-07 07:50:03 +08:00
kl 1fb2b01b7e
fix: Receiver_zipkin missing ServiceInstanceID bug #6749 (#6763) 2021-04-19 11:55:43 +08:00
Zhenxu Ke aecb1b398b
Add some defensive codes of new protobuffers' semantics (#6737) 2021-04-13 20:24:24 +08:00
吴晟 Wu Sheng 17e820f156
Begin 8.6.0 iteration (#6721) 2021-04-09 23:01:00 +08:00
wankai123 4af2b61027
Fix ALS K8SServiceRegistry didn't remove the correct entry (#6658)
* Fix ALS K8SServiceRegistry didn't remove the correct entry

* Add changes

Co-authored-by: Zhenxu Ke <kezhenxu94@apache.org>
2021-04-01 06:14:01 +08:00
Gao Hongtao 7d06c210ae
Resolve envoy service name from a different position (#6654) 2021-03-31 12:09:18 +08:00
Ax1an 1bd397db9b
Add telemetry data about mesh error. (#6550) 2021-03-15 21:13:03 +08:00
Ax1an d9617cbe7b
Add telemetry data about metrics in, metrics scraping and trace in metrics to zipkin receiver. (#6516) 2021-03-11 09:13:49 +08:00
Zhenxu Ke de6a731d72
Save Envoy http access logs when error occurs (#6322) 2021-03-02 22:40:30 +08:00
吴晟 Wu Sheng 0e1d5c3767
Make Zipkin trace query available (#6454) 2021-02-27 14:50:54 +08:00
Zhenxu Ke 665a07cb0f
Clean up some warnings in maven build (#6426) 2021-02-24 07:05:56 +08:00
mrproliu 92d0465cd8
Simplify the Zabbix UT, reduce use time (#6362) 2021-02-11 10:02:37 +08:00
mrproliu 75f03acba7
Adopt Zabbix protocol (#6176)
Happy Chinese New Year !!
2021-02-10 22:40:07 +08:00
Zhenxu Ke b92eac2cd6
Add a new concept "Event" and its implementations to collect events (#6183) 2021-02-05 18:37:18 +08:00
Zhenxu Ke 547f5f1e77
Add some defensive codes for NPE and bump up Kubernetes client version to expose exception stack trace (#6327) 2021-02-05 16:30:54 +08:00
Stephen Ni d4ea997523
chore: add @Override tag on some methods (#6304) 2021-02-03 09:46:57 +08:00
吴晟 Wu Sheng cdfe6ab358
Begin the 8.5.0 iteration (#6302)
* [maven-release-plugin] prepare release v8.4.0

* [maven-release-plugin] prepare for next development iteration
2021-02-02 08:01:49 +08:00
Zhenxu Ke 8c51043dbf
Remove duplicate codes in Envoy ALS handler (#6263) 2021-01-27 12:58:11 +08:00
zifeihan 52c438b9c3
Fix that the dynamic configuration is deleted on the server side but does not take effect on the agent. (#6255)
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2021-01-25 23:24:33 +08:00
wankai123 777c670c66
Support the identification of the source host of the metric data in otel-receiver-plugin (#6243) 2021-01-22 22:24:19 +08:00
zifeihan db61015245
Support dynamic change SAMPLE_N_PER_3_SECS on java agent (#6232) 2021-01-21 15:41:14 +08:00
Zhenxu Ke 6893fec8bb
Fix bug in `parseInternalErrorCode` where some error codes are never reached (#6226) 2021-01-19 16:53:06 +08:00
zifeihan 97f54114a5
Add the implementation of ConfigurationDiscovery on the OAP side. (#6220) 2021-01-19 14:53:49 +08:00
zhang-wei 15452025c6
Log collecting and query implementation (#6120) 2021-01-14 09:49:11 +08:00