Commit Graph

165 Commits

Author SHA1 Message Date
吴晟 Wu Sheng 671cb02982
Bump up Kafka client to 2.8.1 to fix CVE-2021-38153. (#9949) 2022-11-11 15:56:39 +08:00
Jiajing LU d32a318637
Update BanyanDB storage module to adapt BanyanDB 0.2 (#9839)
* update to banyandb client 0.2

* simplify group check and creation

* support indexOnly

* partial apply configuration

* support CompleteableFuture

* fix BanyanDBProfileThreadSnapshotQueryDAO

* optimize BanyanDBProfileTaskQueryDAO

* optimize *LogQueryDAO

* support indexType

* add configuration

* use TTL from core config

Signed-off-by: Megrez Lu <lujiajing1126@gmail.com>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2022-11-04 11:33:21 +08:00
kezhenxu94 6ea51f1745
Bump up jackson databind, snakeyaml, grpc dependencies (#9821) 2022-10-21 09:50:20 +08:00
pg.yang 8aa046b8d7
Add APISIX metrics monitoring (#9725) 2022-10-05 18:23:37 +08:00
kezhenxu94 3e3a39cb66
Bump up snakeyaml to 1.32 (#9647) 2022-09-20 21:56:24 +08:00
kezhenxu94 68090e6da0
Bump up graphql related dependencies (#9628) 2022-09-18 22:51:53 +08:00
kezhenxu94 b3c7658a0e
webapp: migrate from Spring Web to Armeria (#9592) 2022-09-11 16:33:53 +08:00
吴晟 Wu Sheng 18d2463813
Bump up snakeyaml to 1.31 for fixing CVE-2022-25857 (#9567) 2022-09-06 11:20:01 +08:00
kezhenxu94 fefe90be37
Bump up dependencies to fix some cve (#9545) 2022-08-31 13:47:38 +08:00
吴晟 Wu Sheng 608a084350
Begin 9.3.0 iteration, 9.2.0 release is on vote (#9539)
* [maven-release-plugin] prepare release v9.2.0

* [maven-release-plugin] prepare for next development iteration

* Create changes-9.2.0.md

* Update changes.md

* Update LICENSE
2022-08-31 00:31:04 +08:00
kezhenxu94 17968b6690
Bump up kubernetes java client to fix cve (#9498) 2022-08-21 19:32:34 +08:00
kezhenxu94 1377865f3e
Adopt license eye to check dependencies' license (#9220) 2022-08-21 18:31:38 +08:00
Fine0830 df66429f8a
Sync ui: Implement the Event widget and update license (#9261) 2022-06-22 20:52:22 +08:00
kezhenxu94 bc462f0702
Upgrade Armeria to 1.16.0, Kubernetes Java client to 15.0.1 (#9251) 2022-06-21 14:41:11 +08:00
Fine0830 f436e8b6c1
sync ui: visualize a on-demand log widget, update license and submodule (#9170) 2022-06-06 09:48:38 +08:00
kezhenxu94 adac49a14d
Upgrade netty to fix bug in Ubuntu 22 (#9141) 2022-05-27 17:11:54 +08:00
Fine0830 90bdbe059c
Sync UI and update license (#9095) 2022-05-19 08:37:59 +08:00
吴晟 Wu Sheng fcc6a16215
Remove InfluxDB 1.x and Apache IoTDB 0.X as storage options (#9060)
* Remove InfluxDB 1.x and Apache IoTDB as storage options.

* Update dependencies.
2022-05-13 21:30:24 +08:00
吴晟 Wu Sheng c53d242a32
Upgrade OAP and webapp dependencies to fix CVEs. (#8988)
* Upgrade OAP dependencies zipkin to 2.23.16, H2 to 2.1.212, Apache Freemarker to 2.3.31, gRPC-java 1.46.0, netty to 4.1.76.
* Upgrade Webapp dependencies, spring-cloud-dependencies to 2021.0.2, logback-classic to 1.2.11
2022-05-04 23:02:56 +08:00
Superskyyy 211efc0562
Further remove jetty references and config (#8974) 2022-04-29 14:32:44 +08:00
Fine0830 5c247b8d7f
sync ui: Implement the eBPF profiling widget on dashboard (#8943) 2022-04-24 21:36:57 +08:00
Wan Kai f3478b187d
Fix Zipkin receiver: Decode spans error, missing `Layer` for V9 and wrong time bucket for generate Service and Endpoint. (#8848) 2022-04-11 21:34:03 +08:00
吴晟 Wu Sheng 34a4553e23
Bump up versions for Apache httpclient, commons-io, postgresql, log4j2(test codes) (#8811) 2022-04-05 20:26:18 +08:00
Ling Hengqian f280c6c384
Bump up Spring's core version to 5.3.18 in webapp dependencies. (#8802) 2022-04-05 00:12:09 +08:00
Fine0830 d600e7223f
docs: update UI licenses (#8783) 2022-04-01 16:31:06 +08:00
吴晟 Wu Sheng d86880ce7e
Upgrade depdencies (#8781)
* Upgrade OAP dependencies gson(2.9.0), guava(31.1), jackson(2.13.2), protobuf-java(3.18.4).
* Remove commons-pool and commons-dbcp from OAP dependencies(Not used before).
* Upgrade webapp dependencies gson(2.9.0), spring boot(2.6.5), jackson(2.13.2.2), spring cloud(2021.0.1).
2022-04-01 10:16:10 +08:00
吴晟 Wu Sheng faf6e2eb9e
Add `Error Prone Annotations` dependency to suppress warnings (#8774) 2022-04-01 00:57:34 +08:00
刘威 1554c087f4
Refactor IoTDB storage plugin and bump up iotdb-session to 0.12.5 (#8755) 2022-03-30 19:19:49 +08:00
kezhenxu94 289427990a
Migrate the HTTP server from Jetty to Armeria (#8673) 2022-03-15 13:38:42 +08:00
kezhenxu94 b1d3f3b637
Expose more ElasticSearch health check related logs (#8652) 2022-03-10 19:19:44 +08:00
Jared Tan c1765b5177
[OAL] Keep the endpoint avg resp time meter name the same with others scope. (#8534)
* Keep the endpoint avg resp time meter name the same with others scope.

* fix e2e.

* update changes.

* Update CHANGES.md

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>

* sync submodule.

* revert break changes

* fix UT

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2022-02-11 20:48:02 +08:00
kezhenxu94 22e1a89b4a
Bump up PostgreSQL driver to fix CVE (#8497) 2022-02-02 11:18:32 +08:00
刘威 b0a875fe3f
Bump up iotdb-session to 0.12.4 and fix IoTDB storage option bug (#8484)
* Fix IoTDB Storage Option insert null index value.

* Set the default value of SW_STORAGE_IOTDB_SESSIONPOOL_SIZE to 8

* Bump up iotdb-session to 0.12.4

* Update doc
2022-01-30 09:02:39 +08:00
Gao Hongtao 4d803e387f
Fix CVE-2022-23221 (#8464)
* Fix CVE-2022-23221

H2 Console before 2.1.210 allows remote attackers to execute arbitrary code via a jdbc:h2:mem JDBC URL containing the IGNORE_UNKNOWN_SETTINGS=TRUE;FORBID_CREATION=FALSE;INIT=RUNSCRIPT substring

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>
2022-01-22 21:03:08 +08:00
kezhenxu94 2c8504a3ed
Bump up GraphQL related dependencies to latest versions (#8446) 2022-01-19 20:33:25 +08:00
吴晟 Wu Sheng 0d5a289c20
Bump up gRPC/protobuf to fix CVE-2021-22569 (#8405)
* Bump up gRPC/protobuf to fix CVE-2021-2256
2022-01-12 16:39:38 +08:00
吴晟 Wu Sheng 67f6681ba3
Upgrade H2 version to fix GHSA-h376-j262-vhq6 (#8396) 2022-01-07 12:46:12 +08:00
Kirs c3eee0545a
Happy new year! Update NOTICE year (#8371) 2022-01-02 22:44:01 +08:00
kezhenxu94 62ef59466e
Bump up log4j to 2.17.1 (#8349) 2021-12-29 11:07:48 +08:00
kezhenxu94 8fa4eb7d75
Upgrade H2 version to 2.0.202 to fix CVE-2021-23463 (#8332) 2021-12-23 21:37:00 +08:00
kezhenxu94 5da205ba9b
Remove unused jars and bump up netty version in webapp (#8317) 2021-12-21 13:39:37 +08:00
kezhenxu94 a02dd9c2d1
Bump up log4j2 to 2.17 (#8314) 2021-12-18 22:40:38 +08:00
吴晟 Wu Sheng d8fd3ee563
Remove log4j version properties in webapp (#8285)
* Fix license.

* Remove log4j version properties.

* Fix change log.
2021-12-12 11:45:06 +08:00
kezhenxu94 b3536445bc
Bump up Armeria version to fix CVE (#8236) 2021-12-03 13:09:47 +08:00
刘威 842b5d927e
Support Apache IoTDB as a storage option (#7766)
Support Apache IoTDB as a storage option, mostly refer to previous InfluxDB storage option.
* The Design of Apache IoTDB Storage Option, https://skywalking.apache.org/blog/2021-11-23-design-of-iotdb-storage-option/
2021-11-27 09:04:23 +08:00
Marc Navarro a621a2608e
[Enhancement] Bump grpc and protobuff version to allow building on Mac M1 (#8186)
Upgrade to the latest grpc-java 1.42.1 which is only compatible and [tested against](https://github.com/grpc/grpc-java/pull/8551#discussion_r714182190) 3.17.2, but we can assume that 3.17.3 (which has osx-aarch_64 compatible maven artifacts) is save to use.

We could have also upgrade to the latest grpc-java 1.42.1 and latest protoc 3.19.1, but it can not be directly done, it needs to tweak the grpcs-java internal dependencies. So we choose the safest option and discarded this option because of the following reasons:
 - Protoc 3.19.1 generates code that relies on methods not available in protobuf-java 3.17.2 ([“issue”](https://github.com/protocolbuffers/protobuf/issues/9236#issue-1059594027)) (which java-grpc relies on). So we need to tell grpc-java via dependency management to use 3.19.1 instead of 3.17.2.

Signed-off-by: Marc Navarro Sonnenfeld <marcnavarro@tetrate.io>
2021-11-26 22:06:58 +08:00
kezhenxu94 b63008c61e
Upgrade Kubernetes Java client to 14.0.0, supports GCP token refreshing and fixes some bugs (#8122) 2021-11-13 16:24:19 +08:00
kezhenxu94 508945f552
Upgrade Armeria to 1.12, upgrade OpenSearch test version to 1.1.0 (#7866) 2021-10-08 19:45:33 +08:00
kezhenxu94 1feca85f88
Upgrade netty version to 4.1.68.Final avoid cve-2021-37136 (#7799) 2021-09-25 15:57:26 +08:00
吴晟 Wu Sheng 2d52ad42e1
Fix license of netty-tcnative-boringssl-static (#7784) 2021-09-24 08:44:25 +08:00
kezhenxu94 ec03cca31b
Bump up commons-compress version and polish LAL debug error message (#7668) 2021-09-07 12:18:25 +08:00
Fine0830 96d3c1e5dd
Sync UI (#7667) 2021-09-07 09:19:23 +08:00
kezhenxu94 327d946978
Remove docker-maven-plugin in favor of testcontainers (#7664) 2021-09-06 21:04:14 +08:00
kezhenxu94 559b88a17b
Clean up checkstyle import control and unused licenses (#7660) 2021-09-06 17:44:18 +08:00
kezhenxu94 26b81a2e59
Rebuilt ElasticSearch client on top of their REST API (#7634) 2021-09-06 15:21:35 +08:00
吴晟 Wu Sheng 651f7f16ca
Fix CVE-2021-35515, CVE-2021-35516, CVE-2021-35517, CVE-2021-36090 (#7400) 2021-08-03 12:38:08 +08:00
kezhenxu94 65e8ab3ecc
Log rate limit sampler rename `qps` to `rpm` (#7384) 2021-07-29 18:11:07 +08:00
kezhenxu94 fd92f4678a
perf: optimize Groovy-based LAL DSL with static compilation (#7263)
Groovy naturally supports many dynamic features that we don't benefit for now but cost performance loss, in this patch we compile our Groovy-based DSL scripts statically to optimize performance.
2021-07-09 18:00:25 +08:00
Daming 5dd56a5ca4
Upgrade etcd cluster coordinator and dynamic configuration to v3.x (#7215) 2021-07-05 11:23:11 +08:00
Jared Tan 0efc733901
Replace zuul proxy with spring cloud gateway 2.x. in webapp module. (#7220) 2021-07-04 10:24:56 +08:00
Gao Hongtao 669fe1593c
Upgrade OAP dependencies (#7119)
* Introduce trivy to scan images

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Fix CVE

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Update licenses

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Remove log4j 1.x

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Update CHANGES.md

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Update LICENSE refer to webapp

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2021-06-16 12:14:39 +08:00
Gao Hongtao ca155dee05
Upgrade several old dependencies (#7090) 2021-06-10 08:35:31 +08:00
Zhenxu 56f2e86a07
CVE: upgrade snakeyaml to prevent billion laughs attack in dynamic configuration. (#7071) 2021-06-05 14:41:46 +08:00
Zhenxu Ke 94adbf1c1f
Bump Kubernetes client-java version (#6920) 2021-05-10 05:07:09 +08:00
YczYanchengzhe 26de83883a
etcd client problem : fix the byte buff leak reported by io.netty.util.ResourceLeakDetector (#6912) 2021-05-08 07:19:16 +08:00
Zhenxu Ke b850e5c6e1
Bump up Jetty version to fix cve (#6861) 2021-04-28 12:03:25 +08:00
liqiangz 7a53331367
Support alarm tags (#6820) 2021-04-25 17:22:43 +08:00
Qiuxia Fan 9946ec49f6
Sync uI and update license (#6478)
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: Zhenxu Ke <kezhenxu94@apache.org>
2021-03-04 08:14:12 +08:00
吴晟 Wu Sheng 19d4a77235
New doc menu for the website. (#6469) 2021-02-28 11:17:28 +08:00
Zhenxu Ke 96f1c12159
Introduce log analysis language (LAL) (#6388) 2021-02-23 20:06:48 +08:00
haoyann c45bb361ee
Storage plugin supports PostgreSQL (#6345) 2021-02-20 20:59:51 +08:00
Zhenxu Ke 547f5f1e77
Add some defensive codes for NPE and bump up Kubernetes client version to expose exception stack trace (#6327) 2021-02-05 16:30:54 +08:00
Snile f44ed756df
Allow user-defined `JAVA_OPTS` in the startup script (#6316) 2021-02-04 14:23:16 +08:00
吴晟 Wu Sheng 3e4d55083a
Update year to 2021 (#6165)
* Update NOTICE

* Update NOTICE

* Update NOTICE
2021-01-10 18:41:51 +08:00
Lu Jiajing 9b7e663cc1
Update byte-buddy to 1.10.19 (#6037) 2020-12-21 14:07:39 +08:00
Zhenxu Ke 7b9cff4b73
chore: fix typo gprc -> grpc (#6035) 2020-12-20 00:17:46 +08:00
kezhenxu94 8da9bf94ab
ALS analyzer based on Envoy metadata exchange (#5800) 2020-11-09 00:01:12 +08:00
zifeihan a9d756cd53
Fix deadlock problem when using elasticsearch-client-7.0.0 (#5775)
* Update elasticsearch client 7.0.0 to elasticsearch client 7.5.0.
* Update CHANGES.md and LICENSE.
2020-11-03 22:01:54 +08:00
kezhenxu94 92bb474c2d
Improve Kubernetes service registry for ALS analysis (#5722)
The current implementation of envoy ALS K8S analysis is based on the hierarchy, pod -> StatefulSet -> deployment, StatefulSet, or others. It's freaky and different from the Istio Kubernetes registry.

The new path is pod -> endpoint -> service, and we should leverage Informer API instead of raw Kubernetes API.
2020-10-29 18:22:38 +08:00
xbkaishui 2c729b5d69
Support group concept in the alarm core (#5615) 2020-10-03 23:26:29 +08:00
吴晟 Wu Sheng 103cf00672
Support JDK 11 compiling and upgrade dependencies (#5579)
* Upgrade dependencies and make the JDK11 compiling passed.

* Update license and fix license check file.

* Add CI for JDK11 compiling.

* Update doc.
2020-09-29 10:34:21 +08:00
Gao Hongtao 35264e6171
Support SSL for prometheus telemetry and prometheus fetcher (#5431)
* Support SSL for prometheus telemetry and prometheus fetcher
* Documents
* Clear up abandunt dependencies
* Update license

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-09-05 17:01:09 +08:00
吴晟 Wu Sheng b173cde5db
Upgrade the byte-buddy to 1.10.14 with asm (#5338) 2020-08-17 21:27:57 +08:00
yangy 4f011585ee
fix an error when executing startup.bat when the log directory exists (#5213)
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-07-31 22:24:11 +08:00
Daming f9257f5274
Provide kafka as collector/reporter (#4847) 2020-07-30 11:55:49 +08:00
mrproliu 925c0d74c7
Provide server-side meter (#4972) 2020-07-25 21:17:32 +08:00
songzhendong b363b0ea4f
Add Nacos back into SkyWalking as an option(nacos-1.3.1) (#5137) 2020-07-21 23:30:06 +08:00
Evan ad47c9045b
update the kubernetes client verion to 8.0.0 (#4844) 2020-06-22 07:56:39 +08:00
Gao Hongtao 4f0f39ffcc
Ingest prometheus metrics through meter system (#4783) 2020-06-08 09:19:34 +08:00
songzhendong f3d907bf6d
Remove nacos (#4867)
* Add annotation(AlarmCore.start)

* Upgrade nacos version to 1.2.0

* Revert "Upgrade nacos version to 1.2.0"

This reverts commit 4d7b06f6d20ee09ad377ad6ef736aeab429314e0.

* Update nacos version to 1.2.0(Solve the security problem of the old version of fastsjon)

* Recovery annotation

* Recovery annotation

* Update nacos version to 1.2.0

* Update tls_key_generate.sh path

Update tls_key_generate.sh path

* Add annotation(AlarmCore.start)

* Revert "Upgrade nacos version to 1.2.0"

This reverts commit 4d7b06f6d20ee09ad377ad6ef736aeab429314e0.

* Update nacos version to 1.2.0(Solve the security problem of the old version of fastsjon)

* Recovery annotation

* Recovery annotation

* Update tls_key_generate.sh path

* Execution Authority

* Remove nacos

* remove nacos code

* remove nacos

remove nacos

* remove nacos

remove nacos

* remove nacos

* remove nacos

Co-authored-by: songzhendong <289505773@qq.com>
Co-authored-by: songzhendong <songzhendong@xiaomi.com>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-06-06 14:23:12 +08:00
mrproliu 8af10bed11
Support regex to include or exclude the names in alarm module (#4775)
* Support regex to include or exclude the names, requested through mail list, https://lists.apache.org/x/thread.html/rb6d91093776cf61880425449d3d25f9d560cd32363c0075de9a85d13@%3Cdev.skywalking.apache.org%3E

Co-authored-by: Mrproliu <mrproliu@lagou.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2020-05-13 14:34:16 +08:00
mrproliu 749af3e04e
Alarm support multiple scope (#4769)
* Support service relation and database access alarm

* support service instance relation alarm

* support endpoint relation alarm

* document and format the name

* resolve issues

* add database access and endpoint relation rule example

* resolve code format

* remove unnecessary getter and setter package declare

* remove unnecessary fields

Co-authored-by: Mrproliu <mrproliu@lagou.com>
2020-05-11 00:28:10 +08:00
songzhendong 4368f82216
[CVE] Update Nacos 1.0.0 to Nacos 1.2.0(Solve the security problem of the old version of fastjson) (#4753)
* Update nacos version to 1.2.0(Solve the security problem of the old version of fastsjon)

Co-authored-by: songzhendong <289505773@qq.com>
Co-authored-by: songzhendong <songzhendong@xiaomi.com>
2020-05-07 14:51:21 +08:00
吴晟 Wu Sheng 950346c380
[CVE] Update Jetty version to fix its CVEs (#4642) 2020-04-13 14:27:19 +08:00
吴晟 Wu Sheng 44cae97c25
Set up restrict length rules for service, instance and endpoint (#4633)
* Set up restrict length rules for service, instance and endpoint

* Adjust two env names.
2020-04-10 17:59:21 +08:00
吴晟 Wu Sheng 6fe2041b47
Make 8.0.0 Core available. New protocol and register removed. (#4599)
Here are the list of changes we made in this pull request. Top 3 are the principle changes, others are following these principles.
1. New agent and mesh report protocol. 
2. New agent header protocol. 
3. Service register, instance register and network address register have been removed permanently.
4. Service traffic, instance traffic and network alias metrics are added to replace the service, instance and network address inventory.
5. Register process has been removed.
6. Metrics stream process supports insert only mode, especially for traffic entities.
7. Metrics stream process supports no-downsampling mode for traffic entities and network alias.
8. Remove all register mechanism and cache in the java agent.
9. Remove MONTH step in GraphQL query.
10. Update UI to remove MONTH step query, the max query range is 60 days now.
11. Simplify the TTL to metrics and record. And the unit has been formatted in Day unit. No specific TTL for ElasticSearch storage.
12. Buffer mechanism of trace receiver and mesh receiver has been removed due to no register.
13. New service id, instance id and endpoint id rules, including service relation, instance relation and endpoint relation id rules.
14. Java agent support `keep tracing` mode, meaning, agent generating tracing context even the backend is unconnected/unavailable.
15. Plugin test tool up to date, in order to support new protocol.
16. Plugin tests expected data files updated.
17. E2E tests updated.
18. Telemetry of Grafana config has been merged into one.
19. Documentation updates.
20. [TBD] InfluxDB storage implementation is not available, need @dmsolr to fix later, in order to reduce the master change block by this PR.
2020-04-10 11:03:24 +08:00
吴晟 Wu Sheng 54fb6e7285
Set the endpoint name length to 150, to keep safe and avoid over-length. (#4595)
* Set the endpoint name length to 150, to keep safe and avoid over-length.

* Set endpointNameMaxLength in the application.yml

* Fix a mischange.

* Correct the endpoint name length control logic

Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2020-03-31 09:04:10 +08:00
wind2008hxy 203097446a
Set the trustStorePath default value to empty (#4579) 2020-03-27 12:53:59 +08:00
吴晟 Wu Sheng f1b2b298b1
Upgrade jackson-databind version to 2.9.10 (#4565) 2020-03-24 18:42:08 +08:00
kezhenxu94 69e3d80e24
Add selector property in application.yml (#4514)
### Motivation

 Ease the efforts of modifying configurations in automatic workflow and scripts, like Docker and helm chart.

 ### Modification

 Add a `selector` property into `application.yml` to enable switching configuration simply by environment variables or system properties, and filter the unselected options, leaving only selected one.

 ### Result

 - We can switch a configuration by environment variables or system property

 - Closes #4511
2020-03-15 23:28:14 +08:00