Commit Graph

7000 Commits

Author SHA1 Message Date
zhang-wei bfdbd55285
Add template of OpenFunction (#8789) 2022-04-02 18:03:43 +08:00
Kai f8feaa97b7
update UI templates (#8788) 2022-04-01 22:16:36 +08:00
Kai 74fbc3d8ec
update ui-template: browser, general, mesh (#8786) 2022-04-01 20:04:49 +08:00
吴晟 Wu Sheng 98316f57f0
Add profiling doc (#8785) 2022-04-01 17:59:34 +08:00
Fine0830 d600e7223f
docs: update UI licenses (#8783) 2022-04-01 16:31:06 +08:00
吴晟 Wu Sheng d86880ce7e
Upgrade depdencies (#8781)
* Upgrade OAP dependencies gson(2.9.0), guava(31.1), jackson(2.13.2), protobuf-java(3.18.4).
* Remove commons-pool and commons-dbcp from OAP dependencies(Not used before).
* Upgrade webapp dependencies gson(2.9.0), spring boot(2.6.5), jackson(2.13.2.2), spring cloud(2021.0.1).
2022-04-01 10:16:10 +08:00
吴晟 Wu Sheng faf6e2eb9e
Add `Error Prone Annotations` dependency to suppress warnings (#8774) 2022-04-01 00:57:34 +08:00
吴晟 Wu Sheng eb5f755918
Reconstruction doc menu for v9 (#8780) 2022-03-31 22:27:26 +08:00
Kai d08faefe5f
Fix `DatabaseSlowStatement` miss-set service catalog. (#8779)
* Update UI template.
* Sync UI version
2022-03-31 21:03:51 +08:00
mrproliu 72e4b12dc3
Add the Self Observability template of SkyWalking Satellite (#8776) 2022-03-31 18:39:59 +08:00
Kai 29453faa70
sync-ui (#8775) 2022-03-31 16:40:26 +08:00
Kai b57866eb67
Adjust MAL for V9 and update UI template (#8772)
* Add ui template custom folder.
Adjust MAL for V9, remove some group, add new Service func for custom delimiter .
Sync ui.

* changes.md

* fix e2e

* fix e2e

* Update CHANGES.md

* remove e2e oap istio-dp group

* remove  vm group

* fix

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2022-03-31 13:49:07 +08:00
Joseph Stephens 422bea7c45
Reduce false positives from Sonatype Lift (#8769) 2022-03-31 07:53:38 +08:00
刘威 1554c087f4
Refactor IoTDB storage plugin and bump up iotdb-session to 0.12.5 (#8755) 2022-03-30 19:19:49 +08:00
mrproliu 2a8bf4deff
Support eBPF Profiling E2E (#8761) 2022-03-30 12:11:30 +08:00
Kai 3577fe4988
sync ui, add and update ui-templates (#8764) 2022-03-29 22:06:32 +08:00
Kai 81921c2953
UI template init and add control environment variable (#8760) 2022-03-29 07:46:08 +08:00
Mark Dodgson bc2458cf15
added the ignore rule for thread safety (#8736)
Co-authored-by: Joseph Stephens <jstephens@sonatype.com>
2022-03-28 23:39:11 +08:00
absorprofess ac5c4ab3c8
Trim tag's key and value in log query. (#8739) 2022-03-28 20:47:56 +08:00
Kai c8c045a90c
sync-ui (#8756) 2022-03-28 08:38:28 +08:00
吴晟 Wu Sheng d96eed9145
Fix event type of export data, reduce redundancy ThreadLocal in MAL core. (#8754)
* Fix event type of export data is incorrect, it was `EventType.TOTAL` always.
* Reduce redundancy ThreadLocal in MAL core. Improve MAL performance.
* ExpressionDelegate public->private
2022-03-27 16:53:15 +08:00
Kai 5a4d1fbb46
sync-ui (#8753) 2022-03-26 23:10:23 +08:00
吴晟 Wu Sheng d90e2e6ef6
Enhance endpoint dependency analysis to support cross threads cases. (#8747)
* [**Breaking Change**] Remove **Deprecated responseCode** from sources, including Service, ServiceInstance, Endpoint
* Enhance endpoint dependency analysis to support cross threads cases. Refactor span analysis code structures.
* Remove `isNotNormal` service requirement when use alias to merge service topology from client side. All RPCs' peer
  services from client side are always normal services. This cause the topology is not merged correctly.

-----------

In our showcase and Java agent scenarios, there are several cross-thread tracing cases, we were not generating endpoint dependency if ref exists in local and exit span. In this PR, I am adding this missing part back.
Also, in case the downstream endpoint of the dependency is another local/exit span's operation name, which was not generating endpoint traffic before, I add traffic generation of both sides' endpoints of dependency.
Another important point that drives me to fix this is, in the new Booster UI, metrics of endpoint dependency are shown in a separate dashboard, which requires the endpoints of both sides existing in metadata, otherwise, nothing shows up.

For e2e, updated the Java agent to the latest.
2022-03-26 20:00:12 +08:00
Oliver 547f1ede2d
remove redundant exception (#8738) 2022-03-25 14:37:08 +08:00
Kai 40c7eab8d0
sync-ui (#8735) 2022-03-24 21:46:50 +08:00
吴晟 Wu Sheng e0be87b8a1
Add one new layers for k8s (#8732) 2022-03-24 08:03:30 +08:00
Superskyyy 80c177f571
change to more accurate naming (#8733) 2022-03-24 08:02:49 +08:00
kezhenxu94 80d3a4a1ba
Sync NodeJS version and adjust E2E (#8730) 2022-03-23 23:07:45 +08:00
Kai 5114b95ac4
sync-ui (#8729) 2022-03-23 20:19:14 +08:00
吴晟 Wu Sheng 81aad17ca2
Format change logs in a better way. (#8727) 2022-03-23 18:10:12 +08:00
Kai 0dfb93a2d1
Insure span analyze isNormal and Layer consistent. (#8724) 2022-03-22 23:48:00 +08:00
mrproliu ba9cad6d8f
Update the eBPF profiling schedule entity (#8716) 2022-03-22 15:57:56 +08:00
Kai 27c094b35b
sync-ui (#8722) 2022-03-21 19:46:38 +08:00
Cool-Coding b9c5283468
Fix the configuration of `Aggregation` and `GC Count` metrics for oap self observability(#8707) (#8719) 2022-03-21 19:03:39 +08:00
Kai 1207a661b5
sync-ui (#8714) 2022-03-20 20:06:19 +08:00
mrproliu e4dac66e2f
Implement the eBPF profiling query and data collect protocol (#8696) 2022-03-20 19:38:16 +08:00
Kai 2bfa642d36
sync-ui (#8709) 2022-03-19 17:13:59 +08:00
吴晟 Wu Sheng fed3df305e
Fix comments. (#8708) 2022-03-19 09:38:15 +08:00
Kai 2bf7f0f4e7
Support ElasticSearch template mappings `properties parameters` and `_source` update (#8706)
Previous logic can't update the mappings `properties parameters` and `_source` only support adding a new property.

### Now
1. As the OAP core merges the index of metrics, properties would not be deleted still.
2. Would not update the current index to avoid conflict, a new index follows the new template to create.

**Warning**, if there are properties conflicts, same key with different values, they would override each other according to booting sequence. Unless we change booting process as merging modules before merging with existing templates and indices, we can't add check mechanism and warnings.
2022-03-19 00:55:47 +08:00
吴晟 Wu Sheng f956484e21
Add `Column.shardingKeyIdx` for column definition for BanyanDB (#8705)
* Add `Column.shardingKeyIdx` for column definition for BanyanDB.

```
Sharding key is used to group time series data per metric of one entity in one place (same sharding or same 
column for column-oriented database).
For example,
ServiceA's traffic gauge, service call per minute, includes following timestamp values, then it should be sharded by service ID
[ServiceA(encoded ID): 01-28 18:30 values-1, 01-28 18:31 values-2, 01-28 18:32 values-3, 01-28 18:32 values-4]

BanyanDB is the 1st storage implementation supporting this. It would make continuous time series metrics stored closely and compressed better.

NOTICE, this sharding concept is NOT just for splitting data into different database instances or physical files.
```

* Add `JD_PRESERVE_LINE_FEEDS=true` in official code style file. Then our comments don't have to use many blank lines to keep format.
2022-03-18 23:39:52 +08:00
kezhenxu94 6486b13a78
Add complexity limitation for GraphQL query to avoid malicious query (#8703) 2022-03-18 15:38:23 +08:00
kezhenxu94 eccca8506f
Remove fake required workflows (#8692) 2022-03-17 11:29:37 +08:00
kezhenxu94 bf03d9f67a
Improve CI with the GHA new feature (#8691) 2022-03-17 10:06:53 +08:00
吴晟 Wu Sheng a68f2d02fc
Remove the hard requirement of BASE64 encoding for the binary field (#8685)
* Remove the hard requirement of BASE64 encoding for the binary field, and resolved concerns from https://github.com/apache/skywalking/pull/8684#issuecomment-1068660880
2022-03-16 22:16:57 +08:00
Kai 91a82e056a
Add storage column attribute `indexOnly` (#8679)
* Add storage column attribute `indexOnly`, support ElasticSearch only index and not store some fields.
* Add `indexOnly=true` to `SegmentRecord.tags`, to reduce unnecessary storage.
2022-03-16 19:19:29 +08:00
吴晟 Wu Sheng 4def159162
Refactor the core Builder mechanism (#8684) 2022-03-16 08:22:18 +08:00
kezhenxu94 4c7ac43d05
Polish Zipkin HTTP receiver with Armeria APIs (#8680) 2022-03-15 17:11:59 +08:00
kezhenxu94 289427990a
Migrate the HTTP server from Jetty to Armeria (#8673) 2022-03-15 13:38:42 +08:00
kezhenxu94 bbc53dddae
Revert part of #8644, disable otel rules `k8s-cluster` and `k8s-service` by default (#8677) 2022-03-15 07:22:09 +08:00
吴晟 Wu Sheng 08d481e5fc
Enhance DataCarrier#MultipleChannelsConsumer to add priority (#8664)
* Enhance DataCarrier#MultipleChannelsConsumer to add priority for the channels, which makes OAP server has a better
  performance to activate all analyzers on default.
* Activate `receiver-otel#enabledOcRules` receiver with `k8s-cluster,k8s-node,k8s-service,oap,vm` rules on default.
* Activate `satellite,spring-sleuth` for `agent-analyzer#meterAnalyzerActiveFiles`  on default.
* Activate `receiver-zabbix` receiver with `agent` rule on default.
2022-03-11 21:06:25 +08:00