Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Commit c760ec8

Browse files
committed
update
1 parent 195cf79 commit c760ec8

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

56 files changed

+511
-1207
lines changed

PhSHI-Kafka-Test/README.txt

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,16 @@
1+
This is a test of PhSHI! If the test program is applied in other scenarios, problems may occur. Please use with caution!
2+
3+
Befor test, you need start Kafka. You can get quick start kafka related information on kafka's website https://kafka.apache.org/quickstart. If you don't want to build a kafka cluster, you can test it locally by doing the following:
4+
All test in a linux environment with jdk-11.0.2 or higth version. We have provided jdk-11.0.0 in PhSHI-Kafka-Test, you can use it.
5+
6+
First you need start zookeeper, Switch your directory to PhSHI-Kafka-Test/kafka_2.11-1.1.0, then start with the following command: ./bin/zookeeper-server-start.sh ./config/zookeeper.properties
7+
Next, satrt Kafka with this command: ./bin/kafka-server-start.sh ./config/server.properties
8+
Then, you need creat topic for test, you can run creatTopic.sh to create topic.
9+
10+
Now, you should have started Kafka. If you are building a kafka cluster yourself, please modify PhSHI-Kafka-Test/resources/config.properties, change KafkaServer too your server address. You can also change the sub file and event file in config.properties.
11+
12+
Switch you directory to PhSHI-Kafka-Test, first ou need creat sub data and event data use creatSub.sh,creatZipfSub.sh and creatEvent.sh. creatZipfSub.sh creat the sub with Zipf distribution.
13+
14+
eventProducer.sh send the evet frome event data. producer.sh send the sub data from sub data for rein and tama. OpIndex use producerOp.sh. oopindex.sh ,tama.sh and rein.sh run three static version of algorithm. First you start algoorithm, then send sub, after that send event. This test version will test 1,2,4,8,16,32 thread and each mode test 2000 events, please make sure you send the correct number of events. The result data will save in PhSHI-Kafka-Test/resources. The file has one column, save matching time, unit is ms.
15+
16+
The rein-dynamic.sh is the dynamic version of rein. All operations are the same as befor. But the result data has three column, current sub number, matching time and current thread number. Note that every 20 events, we save their average match time and dynamically adjusted time. The unit of time for dynamic adjustment is microseconds.
775 Bytes
Binary file not shown.
5.37 KB
Binary file not shown.
4.17 KB
Binary file not shown.
3.03 KB
Binary file not shown.
1.67 KB
Binary file not shown.
5.16 KB
Binary file not shown.
Binary file not shown.
1.88 KB
Binary file not shown.
7 KB
Binary file not shown.

0 commit comments

Comments
 (0)