Commit Graph

268 Commits

Author SHA1 Message Date
kezhenxu94 de1d0461cc
perf: trim useless metadata fields in ALS to improve performance (#7191)
These fields in `stateMap` metadata are not used by `metadata-service-mapping.yaml` now and there is low possibility that they may be used in real case, but, they cost a lot to deserialize, so we remove them to improve performance

From what I've tested, the analyzer can process 250k ALS logs before trimming the fields and can process 420k ALS logs after trimming the fields
2021-06-28 22:18:14 +08:00
liqiangz d63f3ffcc1
revert #7091 (#7189) 2021-06-28 21:05:28 +08:00
kezhenxu94 e7bc81abbb
Perf: optimize Envoy ALS analyzer performance in high traffic load scenario (reduce ~1cpu in ~10k RPS) (#7182) 2021-06-27 17:56:59 +08:00
kezhenxu94 3536b3c1c4
Extract dependency management to a bom (#7136) 2021-06-20 20:57:26 +08:00
kezhenxu94 528ee6de40
OAL supports generating metrics from events (#7134)
* OAL supports generating metrics from events

* Add new dashboard for event metrics

* Add some docs for event metrics
2021-06-19 20:20:37 +08:00
Zhenxu efcb396f73
Only count 5xx as error in Envoy ALS receiver (#7111) 2021-06-12 07:09:48 +08:00
liqiangz 7a3355f956
Use MAL to calculate JVM metrics, remove OAL dependency. (#7091) 2021-06-11 22:21:10 +08:00
吴晟 Wu Sheng 5eb1021639
Initialize 8.7.0 iteration (#7078) 2021-06-08 07:41:09 +08:00
Zhenxu 56f2e86a07
CVE: upgrade snakeyaml to prevent billion laughs attack in dynamic configuration. (#7071) 2021-06-05 14:41:46 +08:00
Rei Shimizu 3c4f2af158
change log REST endpoint with v3 prefixed (#7062) 2021-06-03 15:56:49 +08:00
wankai123 3034963374
Fix Jetty HTTP `TRACE` issue, disable HTTP methods except `POST`. (#7052) 2021-06-01 16:37:56 +08:00
Zhenxu bd38ec492e
Add HTTP implementation of logs reporting protocol (#7038) 2021-05-30 22:35:55 +08:00
Zhenxu Ke 379c4e1a46
Allow multiple definitions as fallback in `k8sServiceNameRule`. (#7006) 2021-05-25 17:33:07 +08:00
Zhenxu Ke 85a993faf5
Allow multiple definitions as fallback in metadata-service-mapping.yaml file (#6933) 2021-05-13 06:53:05 +08:00
Zhenxu Ke 94adbf1c1f
Bump Kubernetes client-java version (#6920) 2021-05-10 05:07:09 +08:00
Zhenxu Ke 4103551092
bugfix: Envoy error logs are not persisted when no metrics are generated (#6911) 2021-05-07 23:25:20 +08:00
Zhenxu Ke 3b15f8d132
feature: Envoy access log receiver supports TCP logs (#6727) 2021-05-07 07:50:03 +08:00
kl 1fb2b01b7e
fix: Receiver_zipkin missing ServiceInstanceID bug #6749 (#6763) 2021-04-19 11:55:43 +08:00
Zhenxu Ke aecb1b398b
Add some defensive codes of new protobuffers' semantics (#6737) 2021-04-13 20:24:24 +08:00
吴晟 Wu Sheng 17e820f156
Begin 8.6.0 iteration (#6721) 2021-04-09 23:01:00 +08:00
wankai123 4af2b61027
Fix ALS K8SServiceRegistry didn't remove the correct entry (#6658)
* Fix ALS K8SServiceRegistry didn't remove the correct entry

* Add changes

Co-authored-by: Zhenxu Ke <kezhenxu94@apache.org>
2021-04-01 06:14:01 +08:00
Gao Hongtao 7d06c210ae
Resolve envoy service name from a different position (#6654) 2021-03-31 12:09:18 +08:00
Ax1an 1bd397db9b
Add telemetry data about mesh error. (#6550) 2021-03-15 21:13:03 +08:00
Ax1an d9617cbe7b
Add telemetry data about metrics in, metrics scraping and trace in metrics to zipkin receiver. (#6516) 2021-03-11 09:13:49 +08:00
Zhenxu Ke de6a731d72
Save Envoy http access logs when error occurs (#6322) 2021-03-02 22:40:30 +08:00
吴晟 Wu Sheng 0e1d5c3767
Make Zipkin trace query available (#6454) 2021-02-27 14:50:54 +08:00
Zhenxu Ke 665a07cb0f
Clean up some warnings in maven build (#6426) 2021-02-24 07:05:56 +08:00
mrproliu 92d0465cd8
Simplify the Zabbix UT, reduce use time (#6362) 2021-02-11 10:02:37 +08:00
mrproliu 75f03acba7
Adopt Zabbix protocol (#6176)
Happy Chinese New Year !!
2021-02-10 22:40:07 +08:00
Zhenxu Ke b92eac2cd6
Add a new concept "Event" and its implementations to collect events (#6183) 2021-02-05 18:37:18 +08:00
Zhenxu Ke 547f5f1e77
Add some defensive codes for NPE and bump up Kubernetes client version to expose exception stack trace (#6327) 2021-02-05 16:30:54 +08:00
Stephen Ni d4ea997523
chore: add @Override tag on some methods (#6304) 2021-02-03 09:46:57 +08:00
吴晟 Wu Sheng cdfe6ab358
Begin the 8.5.0 iteration (#6302)
* [maven-release-plugin] prepare release v8.4.0

* [maven-release-plugin] prepare for next development iteration
2021-02-02 08:01:49 +08:00
Zhenxu Ke 8c51043dbf
Remove duplicate codes in Envoy ALS handler (#6263) 2021-01-27 12:58:11 +08:00
zifeihan 52c438b9c3
Fix that the dynamic configuration is deleted on the server side but does not take effect on the agent. (#6255)
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2021-01-25 23:24:33 +08:00
wankai123 777c670c66
Support the identification of the source host of the metric data in otel-receiver-plugin (#6243) 2021-01-22 22:24:19 +08:00
zifeihan db61015245
Support dynamic change SAMPLE_N_PER_3_SECS on java agent (#6232) 2021-01-21 15:41:14 +08:00
Zhenxu Ke 6893fec8bb
Fix bug in `parseInternalErrorCode` where some error codes are never reached (#6226) 2021-01-19 16:53:06 +08:00
zifeihan 97f54114a5
Add the implementation of ConfigurationDiscovery on the OAP side. (#6220) 2021-01-19 14:53:49 +08:00
zhang-wei 15452025c6
Log collecting and query implementation (#6120) 2021-01-14 09:49:11 +08:00
Zhenxu Ke afc44d4a3d
Unify the service name rule in `metadata-service-mapping.yml` of `mx-… (#6131) 2021-01-08 13:54:04 +08:00
吴晟 Wu Sheng d36b350197
Fix the priority setting doesn't work of the ALS analyzers (#6121) 2021-01-03 15:08:12 +08:00
Zhenxu Ke f54f639c4d
Enhance Envoy metrics service analyzer by MAL (#6091) 2021-01-02 14:34:54 +08:00
Zhenxu Ke 6101163513
Support Envoy {AccessLog,Metrics}Service API V3 (#6116) 2021-01-01 21:48:38 +08:00
Zhenxu Ke 6feeaf6e5f
Update submodule to sync namespaced proto files (#6026)
* update submodule to sync namespaced proto files

* add compat E2E test and update mock collector

* add changelog, fix GHA syntax, compat Java agent

* highlight notes, use archive dist, revert compat in agent

* polish changelog, add missing `-javaagent` in provider

* fix wrong position of JAVA_OPTS

* polish changelog
2020-12-18 12:29:44 +08:00
Zhenxu Ke 4a0a933d95
chore: remove unused lagecy codes (#5998) 2020-12-12 19:26:12 +08:00
mrproliu 821322447d
Make meter receiver support MAL (#5915) 2020-11-30 17:28:21 +08:00
吴晟 Wu Sheng af19c72a7e
8.3.0 tagged, open for 8.3.0 iteration. (#5920)
* [maven-release-plugin] prepare release v8.3.0

* [maven-release-plugin] prepare for next development iteration
2020-11-29 11:01:20 +08:00
Gao Hongtao 2150904f01
Include SAN to set mTLS property (#5908)
* Include SAN to set mTLS property
* Fix codes as SAN is a list.
* Update the changelog.
Signed-off-by: Gao Hongtao <hanahmily@gmail.com>
Co-authored-by: Wu Sheng <wu.sheng@foxmail.com>
2020-11-27 12:39:09 +08:00
Gao Hongtao b39c4306a8
Observing Istio control plane (#5835)
* Add Istio control plane otel MAL expressions and UI template
* Remove OpenCensus receiver, add OpenTelemetry receiver
* Transfer oc receiver to ot receiver
* Create indices on boot
* Document istio metrics and otel receiver
* Update CHANGES.md
* Fix potential NPE
* Add group to meter and cleanup istio mixer
* Update e2e case due to the change of meter metric name
* Update prometheus fetcher config, fix sql builder issue of h2
* Disable istio and so11y metrics by default.
* Fix micrometer testcase
2020-11-25 21:07:03 +08:00