Commit Graph

76 Commits

Author SHA1 Message Date
wankai123 92c0cb856d
Add function `retagByK8sMeta` and opt type `K8sRetagType.Pod2Service` in MAL for k8s to relate pods and services. (#6608) 2021-03-25 20:50:58 +08:00
Wing 073fbbcab3
Refine event.md (#6622) 2021-03-25 14:29:23 +08:00
Wing 32736dc0e4
Refine backend-overview.md (#6609) 2021-03-24 13:41:50 +08:00
wankai123 c2c3830a80
Add functions in MAL to filter metrics according to the metric value (#6587) 2021-03-20 17:12:34 +08:00
Zhenxu Ke cb16e524da
Enhance the LAL to allow easily skipping logs with malformed formats (#6477) 2021-03-03 17:18:50 +08:00
吴晟 Wu Sheng 19d4a77235
New doc menu for the website. (#6469) 2021-02-28 11:17:28 +08:00
吴晟 Wu Sheng 9ba17cf228
Polish a log to doc and menu for latest status. (#6446)
* Polish a log to doc and menu for latest status.

* Add a skip

* Add .github/actions/skip/action.yml itself to skip file

* Polish doc a little

Co-authored-by: Zhenxu Ke <kezhenxu94@apache.org>
2021-02-26 07:24:32 +08:00
Zhenxu Ke 77082de77b
Add `sum` function in meter system (#6427)
* Add `sum` function in meter system

* Fix minor potential bug and reformat some codes

* Fix a bug

* Use Set to hold the {aggregate,scope} labels as same labels maybe added by multiple aggregation functions

* Separate downsampling function and revert unnecessary codes
2021-02-25 15:10:28 +08:00
Amos Chu 47ec0bb09b
Fix grammar error on (#6440) 2021-02-25 12:40:49 +08:00
Amos Chu 2d258d3176
grammar error for "The answer definitely YES" (#6439) 2021-02-25 11:56:50 +08:00
Zhenxu Ke 96f1c12159
Introduce log analysis language (LAL) (#6388) 2021-02-23 20:06:48 +08:00
Zhenxu Ke 1e4a8ee19b
Fix dead links and add checker to detect them (#6394) 2021-02-18 12:31:22 +08:00
Juntao Zhang b70c9bef67
Replace the URL width https (#6392) 2021-02-18 09:52:18 +08:00
Zhenxu Ke b92eac2cd6
Add a new concept "Event" and its implementations to collect events (#6183) 2021-02-05 18:37:18 +08:00
Stephen Ni cdf69fae63
docs: fix typo (#6271) 2021-01-30 21:03:04 +08:00
Zhenxu Ke f54f639c4d
Enhance Envoy metrics service analyzer by MAL (#6091) 2021-01-02 14:34:54 +08:00
吴晟 Wu Sheng 0c2367a114
Update some doc. (#5942)
* Update manual-sdk.md

* Update README.md

* Update README.md
2020-12-03 17:34:37 +08:00
Gao Hongtao b39c4306a8
Observing Istio control plane (#5835)
* Add Istio control plane otel MAL expressions and UI template
* Remove OpenCensus receiver, add OpenTelemetry receiver
* Transfer oc receiver to ot receiver
* Create indices on boot
* Document istio metrics and otel receiver
* Update CHANGES.md
* Fix potential NPE
* Add group to meter and cleanup istio mixer
* Update e2e case due to the change of meter metric name
* Update prometheus fetcher config, fix sql builder issue of h2
* Disable istio and so11y metrics by default.
* Fix micrometer testcase
2020-11-25 21:07:03 +08:00
Larry e8f30f91b1
Update overview.md (#5874)
fix misspelling words
2020-11-22 16:28:16 +08:00
吴晟 Wu Sheng 9c486a05ee
Support `sideCar.internalErrorCode` in the sources (#5849)
* Support nested sidecar object in the scope.

* Update the changelog.

* Fix comments and docs.
2020-11-17 09:03:48 +08:00
Evan 9b6386f31c
support oal list includes and excludes & add tags to some source (#5739)
* add oal excludes and includes to support tags
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-11-01 09:48:48 +08:00
Gao Hongtao 9ce47d5bdc
Meter Analysis Language (#5531) 2020-10-21 16:45:47 +08:00
Rei Shimizu f48e4961ec
docs: fix broken istio-architecture svg (#5664)
* docs: fix broken istio-architecture svg

* server -> service
2020-10-15 00:19:35 +08:00
zhang-wei 5b5a122b2c
doc fix (#5548) 2020-09-23 23:25:30 +08:00
Gao Hongtao 50d2ff75bc
Parse TLS mode from ALS (#5454)
* Parse tls mode from als

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Polish code

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>
2020-09-13 14:52:39 +08:00
zhang-wei 7ef8b3e476
Support Browser protocol at OAP (#4228) 2020-08-31 15:46:37 +08:00
zhang-wei c5df0760f2
Support IN filter expressions in OAL (#5390) 2020-08-26 23:50:59 +08:00
kezhenxu94 ecc18b9be3
Support !=, like filter expressions in OAL (#5269) 2020-08-11 09:37:21 +08:00
Stalary 1877d0fcf4
Add jvm_thread metrics (#5129) 2020-07-22 09:05:32 +08:00
吴晟 Wu Sheng 377315edbb
Make sure the DB service could be generated. (#4757) 2020-05-08 11:14:16 +08:00
吴晟 Wu Sheng 217bb624f6
Support percentile function in the meter system. (#4725)
* Support percentile function in the meter system.

* Update document.

* Fix formats.
2020-04-29 08:43:26 +08:00
吴晟 Wu Sheng 7c84e77bf2
Support histogram function in Meter system. (#4719)
* Support histogram function in Meter system.
* Add histogram in the document.
* Support infinite-
2020-04-27 14:38:38 +08:00
吴晟 Wu Sheng b635e254c4
Provide Meter(metrics) system (#4694)
Here are the basic and simple usages of the MeterSystem APIs.

## Meter Creation
New meter could be created based on metrics name, function, scope and data type. 
1. Metrics name is still the storage entity name.
2. Functions are every similar with the OAL function, just accepting different input.
```java
final MeterSystem meterSystem = MeterSystem.meterSystem(getManager());
meterSystem.create("test_long_metrics", "avg", ScopeType.SERVICE, Long.class);
```
NOTICE, this creation should only be called in the `module#prepare` stage, otherwise, `Can't create new metrics anymore` exception will be raised after the **CORE** module `start` stage finished. You may find out, there is a chance `create` could be executed successfully in your own `module#start` stage, but it it just because of the sequence of provider loaded by the class loader, **no guarantee, so please don't do that**.

## Runtime Calculation
`AcceptableValue` is the object created at the runtime to accept new metrics value.
```java
         final MeterSystem service = getManager().find(CoreModule.NAME).provider().getService(MeterSystem.class);
        Executors.newSingleThreadScheduledExecutor().scheduleAtFixedRate(new Runnable() {
            @Override
            public void run() {
                final AcceptableValue<Long> value = service.buildMetrics("test_long_metrics", Long.class);
                value.accept(MeterEntity.newService("abc"), 5L);
                value.setTimeBucket(TimeBucket.getMinuteTimeBucket(System.currentTimeMillis()));
                service.doStreamingCalculation(value);
            }
        }, 2, 2, TimeUnit.SECONDS);
```

## Meter Functions
Right now, only `avg` function has been implemented. I submit this PR as soon as possible to get your feedback. I will add more functions.

## Notice
1. Make slow trace query available in the sampled record. Logically, they are the same thing. The UI doesn't need to concern about the trace as a special case.
2. Endpoint dependency will be removed from the dashboard. Because no query available for it. We will provide a new page for that in 8.1
3. Comparison page will be removed due to dashboard is powerful enough to replace it.
2020-04-24 23:33:13 +08:00
Weiyi Liu cf7482a79c
Fix typo. (#4693) 2020-04-23 11:25:40 +08:00
Randy Abernethy a45fb308f8
Syntax, grammar and basic cleanup. (#4575)
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-03-27 07:54:41 +08:00
吴晟 Wu Sheng 9149de2a6e Support multiple linear values and merging p50/75/90/95/99 into percentile (#4214)
* Support new percentile func with new alarm and exporter for this new func.

* Fix e2e and OAL script

* Fix wrong column.

* Fix percentile bug and oal engine bug.

* Update query protocol and add percentile test case

* Support new query

* Adopt GraphQL requirement

* Fix wrong type cast.

* Fix query in H2 and ES.

* Fix docs and comments.

* Fix an e2e compile issue

* Fix javadoc issue and e2e test issue.

* Change CPM to Apdex in TTL test.

* Fix OAL for TTL e2e

* Add metrics query for service percentile.

* Fix OAL engine bug. Method deserialize is not working when more than two field types are IntKeyLongValueHashMap

* Support multiple IntKeyLongValueHashMap fields in remote. About serialize/deserialize methods.

* Fix graphql statement error in e2e.

* Fix serialize not working and add generated serialize/deserialize of percentile into test cases.

* Fix test case format

* Remove generated code test.

* Fix failed e2e test

* Use avg resp time to apdex in the TTL test.

* ADD multiple linear metrics check for endpoint in e2e cluster.

* Support `-` to represent no threshold and doc of alarm about this.

* Move break to right place.

* Fix wrong break(s)

* Fix break and add a test case for multiple values alarm.

* Fix format.

* Add more doc for this new feature and GraphQL query protocol.

Co-authored-by: Jared Tan <jian.tan@daocloud.io>
Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
2020-01-12 22:10:50 +08:00
吴晟 Wu Sheng 06bdff0e02
Add documents for apdex and parameter explanation for heatmap, apdex and p99 (#4142) 2019-12-27 22:09:03 +08:00
kezhenxu94 3f2f75a666
Add SkyWalking CLI download links (#4038) 2019-12-10 21:20:10 +08:00
zoidbergwill fe98490b97 Fix Istio architecture link (#3885) 2019-11-18 19:26:17 +08:00
吴晟 Wu Sheng 922eb09a04
Fix missing fields in scope-definitions.md (#3721)
* Update scope-definitions.md

* Update Jenkinsfile
2019-10-27 17:22:14 +08:00
吴晟 Wu Sheng af51e23b72 Reorganize the doc, and provide catalog (#3563) 2019-10-06 15:34:03 +08:00
吴晟 Wu Sheng e1ce6edfab Fill my FAQ reply in official document. (#3450)
* Fill my FAQ reply in official document.

* Add image.
2019-09-11 07:09:50 +08:00
吴晟 Wu Sheng 5b039e9747 All NEW OAL Runtime Engine (#3109)
* Change OAL generator tool to runtime.

Step 1. change project structure. API links and maven pom.

* Part of metrics class generation

* Metrcis class generated.

* Set up the basic structure of new OAL engine.

* Finish metrics generation.

* Support dispatcher generation.

* Format codes.

* Generate dispatcher all methods.

* Implement disable in hardcode.

* Clear up

* Fix compile startup.

* Update license and document of new OAL engine.

* Fix rat.

* Disable class output in default

* Copy from @kezhenxu94 's test PR, https://github.com/apache/skywalking/pull/3110

* Wait for the mount command to finish
2019-07-18 19:47:23 +08:00
彭勇升 pengys ed78dabe8b Rename metric and indicator to metrics. (#2643)
* Rename metric to metrics.

* Fixed test case execute failure issues.
2019-05-10 08:05:37 +08:00
于玉桔 b54d9ff6d1 Update service-mesh-probe.md (#2442)
Make the Istio img address available.
2019-04-03 21:57:49 -07:00
吴晟 Wu Sheng 9a09e96204 Support disable statement in OAL (#2402)
* Try to make disable work.

* Make disable works.

* Add disable document.
2019-03-26 23:34:31 +08:00
kezhenxu94 4454721030 doc: fix typo and list numbers (#2339) 2019-03-10 18:36:39 +08:00
tianyu 8824bef6d1 Update probe-introduction.md (#2324) 2019-03-07 13:12:06 +08:00
Jared Tan 8f866fecd9 add probe and some setup cn docs. (#2280) 2019-02-22 17:52:06 +08:00
Jared Tan bb800863f2
cn docs. (#2273) 2019-02-22 09:32:01 +08:00