Commit Graph

47 Commits

Author SHA1 Message Date
Jared Tan c596d0ac82 add serviceInstanceId in Segment storage. (#2146)
* add serviceInstanceId in Segment storage.

* add serviceInstanceId in query condition.
2019-02-23 07:59:19 +08:00
吴晟 Wu Sheng 479ee33244
Correct trace id in slow db statement (#2254)
* Correct trace id.

* Fix match.

* Add cover token to retry.

* Retry new test plugin.

* Reset to jacoco.

* Update jacoco version.
2019-02-19 13:02:54 +08:00
吴晟 Wu Sheng 333bcd48e0
Provide slow database rule document. (#2253) 2019-02-18 21:23:36 +08:00
吴晟 Wu Sheng 2f3ccf368c
Backend streaming thread model improvement (#2247)
[Performance Improvement]Backend streaming thread model improvement
2019-02-18 14:55:07 +08:00
吴晟 Wu Sheng 4babd6ff73 Support Top sql (#2239)
* The prototype of topN sql worker.

* Add scope and new manual dispatcher.

* no message

* Finish topN persistence codes. Not test yet. And query have not added.

* Finish the top n database statement persistent.

* Support different slow thresholds for different db types.

* Fix wrong db default threshold

* Finish new query protocol binding.

* Provide query empty implementation and sync ui.

* Finish all codes, hope it works :P
I will run the tests tonight.

* Fix

* Fix

* Fix a startup issue.

* Add time bucket to persistent.

* Fix wrong query result column name.

* Fix Database query.

* Fix checkstyle.

* Fix wrong order logic, and add a test case to verify, to fix https://github.com/apache/incubator-skywalking/pull/2239#discussion_r255948249
2019-02-12 23:13:02 +08:00
Lemon f7ca26729d Database metrics provided. (#2025)
* Add Database source

* Add DatabaseSource source and database_* script for oal

* Enable Database_Indicator

* Add file license

* Rename DatabaseService to ClientDatabase. In the future, we may have real database server monitoring.

* Add query database from H2

* refactor

* update submodule

* refactor

* Fix style

* Fix: unknown tag error

* fix checkstyle
2019-01-27 08:27:34 +08:00
彭勇升 pengys 9810c5e308 Improve buffer reader speed. (#2188)
* 1. Sleep 500 milliseconds after a batch re-call finish.
2. Re-create register lock index when the system property named debug is setting.
3. Get the register inventory before lock to avoid increment the sequence but not use.
4. Return the exchange flag after all the references and spans in one segment parsed to reduce the number of segment parse.
5. Put the not exchanged segment into a collection then try to exchange no more than 10 times because of the exchange is asynchronous.
6. Cache the segment object to avoid repeated deserialization.

#2185

* #2185
1. Sleep 500 milliseconds after a batch re-call finish.
2. Re-create register lock index when the system property named debug is setting.
3. Get the register inventory before lock to avoid increment the sequence but not use.
2019-01-21 04:21:45 +08:00
彭勇升 pengys 33f5cc19b5 Fixed the inventory register lock invalid bug. (#2184)
* #2183

Merge commit into master.

* Make the h2 register lock same as mysql.
2019-01-20 16:41:06 +08:00
a3e03f6133 Un-exchanged endpoint name in ref can't find the id (#2162)
* Update ReferenceIdExchanger.java

Change comments of codes.
2019-01-15 20:38:05 +08:00
吴晟 Wu Sheng b5eb9e304d Support Service Instance Inventory properties and bug fixed (#2156)
* Refactor service instance inventory to properties based entity.

* Fix a bug and refactor properties update.
2019-01-13 22:07:52 +08:00
吴晟 Wu Sheng 9cc5e76d97
Support service inventory extension fields in json format (#2148)
* Add properties for service inventory

* Fix code bugs

* Provide develop doc for inventory extension.
2019-01-11 21:24:51 +08:00
吴晟 Wu Sheng 5f57e561c7 Provide grafana settings for telemetry (#2138)
* Change a label name for  sw instance to avoid confict.

* Fix a wrong metric name.

* Fix too many counter instances.

* Set uptime to second.

* Fix format.

* Fix format

* Remove two unnecessary counter.

* Provide grafana dashboard settings and remove unnecessary metric.

* Provide a simple UI brief doc. Fix #2137
2019-01-10 07:27:23 +08:00
吴晟 Wu Sheng 6499d4f583
Implement Prometheus to oap backend telemetry (#2133)
* Finish the basic codes of telemetry.

* Add many telemetry in oap.

* Fix a test case.

* Finish all telemetry metric.

* Fix format.

* Make telemetry works.

* Support JVM metrics.

* Add doc for telemetry.

* Fix typo.

* Fix #2135
2019-01-08 23:20:13 +08:00
吴晟 Wu Sheng c7884694da
Move node type from network address to service level[Need storage module update] (#2051)
* Change srcLayer to nodeType. Add nodeType in service inventory entity.

* NodeType value refactor.

* Format codes.

* Fix compile issue.

* Fix bugs, and make query on service inventory instead of network inventory
2018-12-17 09:05:16 -08:00
彭勇升 pengys dfe2b08599 [OAP Server][Cluster Plugin] Provide consul cluster plugin (#2036)
* Provide consul cluster plugin.

* Change log and application config file.

* Add consul's config item into the docker's application.yml.

* Fixed bug.

* Add consul description into  readme.

* Add okhttp component license.
2018-12-12 08:14:41 -08:00
Jared.Tan 1b1a9bf216 Remove unused Debug Switches 2018-12-06 11:00:43 +08:00
吴晟 Wu Sheng 5577f67de7 Support backend sampling (#1977)
* Support sampling trace at server side and keep metric right.

* Add a trace sampling document

* Fix wrong default value.

* Fix document issue.

* Fix assemble issue.

* Fix wrong settings and doc.
2018-11-29 23:33:07 +08:00
吴晟 Wu Sheng 215eab7428
Mysql style storage implementation (#1964)
Also fixed several bugs in this merge.
2018-11-28 22:59:02 +08:00
彭勇升 pengys 983f7613b6 1. Close the output stream when switch to write next file. (#1958)
2. Close the input stream when switch to read next file.

#1665
2018-11-25 16:49:35 +08:00
彭勇升 pengys 7c8a683c2f
gRPC client usage improve (#1946)
* Close the clients which are unreachable.
Remote client manager test case and comments.

* Test the GRPCRemote client.

* 1. Catch the throwable for onComplete method cause of it will throw exception when connection lost.
2. Check the gRPC channel state, send message when state is ready, wait 5 second when state is not ready.

Notice: gRPC channel getState with true parameter will trigger reconnect operation.

* gRPC client will reconnect to the server when network recorvered.

* Recovery application.yml

* Recovery proto module commit id.

* no message

* Fixed compile error.
2018-11-22 20:50:27 +08:00
吴晟 Wu Sheng c6ada8c98f
Support new v2 protocol and make concept consistently (#1937)
* Update new protocol

* Support new protocol at agent side.

* Fix test case.

* Make backend supports new trace protocol

* Fix tests.

* Make all new services available in gRPC.

* Fix bugs.

* Finish new document for v2 trace protocol.

* Fix wrong version requirement of zk

* Fix trace query bug.

* Find a client side dictionary bug.

* Fix register bugs.

* Fix break doc links.
2018-11-21 22:33:04 +08:00
彭勇升 pengys 0ae26f8e6e Fixed a bug which the segment record index does not delete the history data because of the saving time bucket is a second format date, but the query delete is minute format date. (#1943)
#1942
2018-11-21 13:08:08 +08:00
吴晟 Wu Sheng 6b35113536 Restore Zipkin receiver based on new core (#1932)
* Change some codes to make zipkin receiver works, not done yet.

* @adriancole Zipkin receiver is coming back again.

* Fix document and fix for Zipkin receiver.

* Fix some bugs.

* Fix register bug.

* Fix transfer bug for new backend core.
2018-11-18 22:46:27 +08:00
彭勇升 pengys afd6164335 OAP server testing module. (#1931)
* OAP server testing module.

#1930

* #Missing delete code.
2018-11-18 20:22:56 +08:00
吴晟 Wu Sheng 645a9a579d
New v2 header with header key `sw6` (#1894)
* Add some supports to sw6 header. Break many test cases because I turn sw3 default off. For sure, you could open in agent.conf.  FYI @peng-yongsheng @ascrutae

* Fix CI and make user cases still work under v1 header.

* Support BASE64 in v2 header and make entryOperationName and parentOperationName optional in ContextCarrier or ContextSnapshot

* Fix CI.

* @peng-yongsheng This is backend related, please pay attention.

* Fix the carrier item order is incorrect (#1903)
2018-11-12 17:42:17 +08:00
彭勇升 pengys 884dd8c59e Add detect point to be a part of unique key of the endpoint id. (#1874) 2018-11-03 00:55:00 +08:00
彭勇升 pengys 9b3192fbac Set span layer into network inventory for distinguish what the network address is. MQ? DB? ... (#1824) 2018-10-26 22:57:05 +08:00
彭勇升 pengys 24e958fec0 1. Fixed the bug of inventory equals method. (#1814)
2. Fixed the bug of agent mock register order.
3. Fixed the bug of all heatmap.
2018-10-25 21:23:20 +08:00
彭勇升 pengys 6c92fc5484 1. Delete service component indicator. (#1809)
2. Make service relation and endpoint relation to record component id.
3. Delete service mapping indicator.
4. Make service inventory to record mapping service id.
5. Refactor global topology query and service topology query.
2018-10-25 11:19:31 +08:00
彭勇升 pengys 064595eb81 Fixed the segment parse bug. Each use requires the creation of a new instance. (#1784) 2018-10-17 19:13:08 +08:00
彭勇升 pengys b367c36db9
Fixed the endpoint topology bug. (#1778)
* Delete the client side endpoint relation indicator.
Fixed the endpoint topology bug.

* Fixed package failure bug.
2018-10-17 11:28:16 +08:00
彭勇升 pengys 72f2b1cd78 Provide rest protocol for register and trace receiver. (#1774) 2018-10-16 17:01:49 +08:00
彭勇升 pengys 966d5f54f1 Fixed the bugs, #1750, #1749, #1748, #1746, #1745 (#1755) 2018-10-11 19:37:57 +08:00
彭勇升 pengys a062fdae71 Fixed the bug from topology. (#1736)
* Fixed the bug from topology.

* no message
2018-10-09 20:33:04 +08:00
彭勇升 pengys 065a384f10 Trace buffer test success. (#1733) 2018-10-08 23:17:15 +08:00
吴晟 Wu Sheng 4cae884fc0
Add endpoint id to trace query. (#1722) 2018-09-28 19:22:15 +08:00
吴晟 Wu Sheng 813ea1ed39 Make DetectPoint in Mesh gRPC protocol, DetectPoint in Source, and SpanSrcType convert right. (#1714) 2018-09-28 11:52:31 +08:00
吴晟 Wu Sheng 9d6bf6787b
Finish mesh source dispatch (#1687)
* Merge module and provider of mesh

* Finish the skeleton of mesh receiver.

* Finish mesh dispatcher.

* Fix missing timebucket
2018-09-26 08:20:55 +08:00
彭勇升 pengys 53b9e7f828 Implementation of aggregation query. (#1702) 2018-09-25 19:14:37 +08:00
彭勇升 pengys 0576466031 Implementation of metadata query. (#1686) 2018-09-21 11:47:40 +08:00
彭勇升 pengys 13fa30307a Add record persistence stream analysis. (#1683) 2018-09-19 15:21:56 +08:00
吴晟 Wu Sheng 5a55b9ba1b Provide Pxx(p99,p95,p90,p75,p50) indicators and All dispatcher (#1654)
* Add 3 cases for existed indicators.

* Add Pxx indicator.

* Support All in trace analysis listener.

* Fix CI and add P99/95/90/75/50 to source ALL.
2018-09-11 16:20:22 +08:00
彭勇升 pengys bc571259b2
Streaming analysis topology test success. (#1646)
* Add generate indicator and dispatcher about service topology but not test.

* Delete call type from service relation.

* Streaming analysis topology test success.

* Fixed the check style error.
2018-09-09 15:30:43 +08:00
彭勇升 pengys 800a5353de Add generate indicator and dispatcher about service topology but not test. (#1638)
* Add generate indicator and dispatcher about service topology but not test.

* Delete call type from service relation.
2018-09-07 11:59:55 +08:00
刘新元 Liu XinYuan f0f4cde494 add the methods that are not in the graphql resolver and the classes … (#1634)
* add the methods that are not in the graphql resolver and the classes that are not in the type, and resolve the StackOverFlowOver that starts the report.

* add license

* update file header
2018-09-06 21:11:07 +08:00
吴晟 Wu Sheng 86452fd2b6 Fix all sources and sourceDispatchers. (#1620) 2018-09-04 17:36:44 +08:00
彭勇升 pengys d0e68872da SkyWalking's trace receiver implementation. (#1618)
* Buffer stream.

* Buffer file reader.

* Buffer library performance test and functional test successfully.

* Fixed the code merge mistake.

* SkyWalking's trace receiver implementation.

* SkyWalking's trace receiver implementation.

* Delete collector module.
2018-09-04 11:18:29 +08:00