Commit Graph

1208 Commits

Author SHA1 Message Date
kezhenxu94 118ba3b569
Fix wrong example in doc, sync Python E2E version and adjust E2E (#8751)
* Fix wrong example in doc, sync Python E2E version and adjust E2E
2022-04-07 13:02:21 +08:00
吴晟 Wu Sheng 91413a753c
Start 9.1.0-dev iteration (#8822) 2022-04-06 18:56:49 +08:00
Kai 4e750e69fb
add missing unit (#8821) 2022-04-06 16:43:28 +08:00
zhang-wei de978e18df
Add trace of Browser dashboard (#8819) 2022-04-06 14:50:19 +08:00
Felixnoo 0d3c20b48f
Update OpenFunction Doc URL (#8814)
Signed-off-by: Felixnoo <felixliu@kubesphere.io>
2022-04-06 12:07:23 +08:00
Kai 1ca53a12ed
Sync UI and update templates (#8800) 2022-04-04 22:02:08 +08:00
Kai b670ea6031
Update ui-template and sync UI (#8795) 2022-04-03 14:59:00 +08:00
zhang-wei bfdbd55285
Add template of OpenFunction (#8789) 2022-04-02 18:03:43 +08:00
Kai f8feaa97b7
update UI templates (#8788) 2022-04-01 22:16:36 +08:00
Kai 74fbc3d8ec
update ui-template: browser, general, mesh (#8786) 2022-04-01 20:04:49 +08:00
吴晟 Wu Sheng d86880ce7e
Upgrade depdencies (#8781)
* Upgrade OAP dependencies gson(2.9.0), guava(31.1), jackson(2.13.2), protobuf-java(3.18.4).
* Remove commons-pool and commons-dbcp from OAP dependencies(Not used before).
* Upgrade webapp dependencies gson(2.9.0), spring boot(2.6.5), jackson(2.13.2.2), spring cloud(2021.0.1).
2022-04-01 10:16:10 +08:00
吴晟 Wu Sheng faf6e2eb9e
Add `Error Prone Annotations` dependency to suppress warnings (#8774) 2022-04-01 00:57:34 +08:00
Kai d08faefe5f
Fix `DatabaseSlowStatement` miss-set service catalog. (#8779)
* Update UI template.
* Sync UI version
2022-03-31 21:03:51 +08:00
mrproliu 72e4b12dc3
Add the Self Observability template of SkyWalking Satellite (#8776) 2022-03-31 18:39:59 +08:00
Kai 29453faa70
sync-ui (#8775) 2022-03-31 16:40:26 +08:00
Kai b57866eb67
Adjust MAL for V9 and update UI template (#8772)
* Add ui template custom folder.
Adjust MAL for V9, remove some group, add new Service func for custom delimiter .
Sync ui.

* changes.md

* fix e2e

* fix e2e

* Update CHANGES.md

* remove e2e oap istio-dp group

* remove  vm group

* fix

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2022-03-31 13:49:07 +08:00
刘威 1554c087f4
Refactor IoTDB storage plugin and bump up iotdb-session to 0.12.5 (#8755) 2022-03-30 19:19:49 +08:00
mrproliu 2a8bf4deff
Support eBPF Profiling E2E (#8761) 2022-03-30 12:11:30 +08:00
Kai 3577fe4988
sync ui, add and update ui-templates (#8764) 2022-03-29 22:06:32 +08:00
Kai 81921c2953
UI template init and add control environment variable (#8760) 2022-03-29 07:46:08 +08:00
absorprofess ac5c4ab3c8
Trim tag's key and value in log query. (#8739) 2022-03-28 20:47:56 +08:00
吴晟 Wu Sheng d96eed9145
Fix event type of export data, reduce redundancy ThreadLocal in MAL core. (#8754)
* Fix event type of export data is incorrect, it was `EventType.TOTAL` always.
* Reduce redundancy ThreadLocal in MAL core. Improve MAL performance.
* ExpressionDelegate public->private
2022-03-27 16:53:15 +08:00
吴晟 Wu Sheng d90e2e6ef6
Enhance endpoint dependency analysis to support cross threads cases. (#8747)
* [**Breaking Change**] Remove **Deprecated responseCode** from sources, including Service, ServiceInstance, Endpoint
* Enhance endpoint dependency analysis to support cross threads cases. Refactor span analysis code structures.
* Remove `isNotNormal` service requirement when use alias to merge service topology from client side. All RPCs' peer
  services from client side are always normal services. This cause the topology is not merged correctly.

-----------

In our showcase and Java agent scenarios, there are several cross-thread tracing cases, we were not generating endpoint dependency if ref exists in local and exit span. In this PR, I am adding this missing part back.
Also, in case the downstream endpoint of the dependency is another local/exit span's operation name, which was not generating endpoint traffic before, I add traffic generation of both sides' endpoints of dependency.
Another important point that drives me to fix this is, in the new Booster UI, metrics of endpoint dependency are shown in a separate dashboard, which requires the endpoints of both sides existing in metadata, otherwise, nothing shows up.

For e2e, updated the Java agent to the latest.
2022-03-26 20:00:12 +08:00
Oliver 547f1ede2d
remove redundant exception (#8738) 2022-03-25 14:37:08 +08:00
吴晟 Wu Sheng e0be87b8a1
Add one new layers for k8s (#8732) 2022-03-24 08:03:30 +08:00
Superskyyy 80c177f571
change to more accurate naming (#8733) 2022-03-24 08:02:49 +08:00
Kai 0dfb93a2d1
Insure span analyze isNormal and Layer consistent. (#8724) 2022-03-22 23:48:00 +08:00
mrproliu ba9cad6d8f
Update the eBPF profiling schedule entity (#8716) 2022-03-22 15:57:56 +08:00
Cool-Coding b9c5283468
Fix the configuration of `Aggregation` and `GC Count` metrics for oap self observability(#8707) (#8719) 2022-03-21 19:03:39 +08:00
mrproliu e4dac66e2f
Implement the eBPF profiling query and data collect protocol (#8696) 2022-03-20 19:38:16 +08:00
吴晟 Wu Sheng fed3df305e
Fix comments. (#8708) 2022-03-19 09:38:15 +08:00
Kai 2bf7f0f4e7
Support ElasticSearch template mappings `properties parameters` and `_source` update (#8706)
Previous logic can't update the mappings `properties parameters` and `_source` only support adding a new property.

### Now
1. As the OAP core merges the index of metrics, properties would not be deleted still.
2. Would not update the current index to avoid conflict, a new index follows the new template to create.

**Warning**, if there are properties conflicts, same key with different values, they would override each other according to booting sequence. Unless we change booting process as merging modules before merging with existing templates and indices, we can't add check mechanism and warnings.
2022-03-19 00:55:47 +08:00
吴晟 Wu Sheng f956484e21
Add `Column.shardingKeyIdx` for column definition for BanyanDB (#8705)
* Add `Column.shardingKeyIdx` for column definition for BanyanDB.

```
Sharding key is used to group time series data per metric of one entity in one place (same sharding or same 
column for column-oriented database).
For example,
ServiceA's traffic gauge, service call per minute, includes following timestamp values, then it should be sharded by service ID
[ServiceA(encoded ID): 01-28 18:30 values-1, 01-28 18:31 values-2, 01-28 18:32 values-3, 01-28 18:32 values-4]

BanyanDB is the 1st storage implementation supporting this. It would make continuous time series metrics stored closely and compressed better.

NOTICE, this sharding concept is NOT just for splitting data into different database instances or physical files.
```

* Add `JD_PRESERVE_LINE_FEEDS=true` in official code style file. Then our comments don't have to use many blank lines to keep format.
2022-03-18 23:39:52 +08:00
kezhenxu94 6486b13a78
Add complexity limitation for GraphQL query to avoid malicious query (#8703) 2022-03-18 15:38:23 +08:00
kezhenxu94 bf03d9f67a
Improve CI with the GHA new feature (#8691) 2022-03-17 10:06:53 +08:00
吴晟 Wu Sheng a68f2d02fc
Remove the hard requirement of BASE64 encoding for the binary field (#8685)
* Remove the hard requirement of BASE64 encoding for the binary field, and resolved concerns from https://github.com/apache/skywalking/pull/8684#issuecomment-1068660880
2022-03-16 22:16:57 +08:00
Kai 91a82e056a
Add storage column attribute `indexOnly` (#8679)
* Add storage column attribute `indexOnly`, support ElasticSearch only index and not store some fields.
* Add `indexOnly=true` to `SegmentRecord.tags`, to reduce unnecessary storage.
2022-03-16 19:19:29 +08:00
吴晟 Wu Sheng 4def159162
Refactor the core Builder mechanism (#8684) 2022-03-16 08:22:18 +08:00
kezhenxu94 4c7ac43d05
Polish Zipkin HTTP receiver with Armeria APIs (#8680) 2022-03-15 17:11:59 +08:00
kezhenxu94 289427990a
Migrate the HTTP server from Jetty to Armeria (#8673) 2022-03-15 13:38:42 +08:00
kezhenxu94 bbc53dddae
Revert part of #8644, disable otel rules `k8s-cluster` and `k8s-service` by default (#8677) 2022-03-15 07:22:09 +08:00
吴晟 Wu Sheng 08d481e5fc
Enhance DataCarrier#MultipleChannelsConsumer to add priority (#8664)
* Enhance DataCarrier#MultipleChannelsConsumer to add priority for the channels, which makes OAP server has a better
  performance to activate all analyzers on default.
* Activate `receiver-otel#enabledOcRules` receiver with `k8s-cluster,k8s-node,k8s-service,oap,vm` rules on default.
* Activate `satellite,spring-sleuth` for `agent-analyzer#meterAnalyzerActiveFiles`  on default.
* Activate `receiver-zabbix` receiver with `agent` rule on default.
2022-03-11 21:06:25 +08:00
Kai 9c46d6f8d4
Fix es normal index couldn't apply mapping and update (#8661) 2022-03-11 10:24:17 +08:00
吴晟 Wu Sheng d1f5b58f5c
[Breaking Change] Deprecate `All` from OAL source. (#8656)
* Add source `event` generated metrics to SERVICE_CATALOG_NAME catalog.
* [Breaking Change] Deprecate `All` from OAL source.
* [Breaking Change] Remove `SRC_ALL: 'All'` from OAL grammar tree.
* Remove `all_heatmap` and `all_percentile` metrics.
2022-03-10 22:36:22 +08:00
kezhenxu94 b1d3f3b637
Expose more ElasticSearch health check related logs (#8652) 2022-03-10 19:19:44 +08:00
mrproliu 6bc2c3307a
Implement process metadata query protocol (#8649) 2022-03-10 17:08:03 +08:00
Kai 3a31cbe222
return all Layer definition names within OAP (#8651) 2022-03-10 13:40:23 +08:00
Kai f3743ee017
Introduce booster-ui and implement v9 template management protocol (#8637) 2022-03-09 08:15:55 +08:00
kezhenxu94 eb7529adb6
Support large service list query and replace deprecated API of Armeria (#8628) 2022-03-08 13:18:18 +08:00
吴晟 Wu Sheng 4b0504fd5d
Update codeStyle.xml to fix incompatibility (#8623) 2022-03-07 07:56:47 +08:00