Mirrors
/
flink
mirror of https://github.com/apache/flink.git
2
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
release-2.0
release-1.20
release-1.19
master
dependabot/npm_and_yarn/flink-runtime-web/web-dashboard/multi-0dbc78daaa
dependabot/maven/flink-end-to-end-tests/flink-sql-client-test/org.apache.kafka-kafka-clients-3.7.1
dependabot/maven/flink-end-to-end-tests/flink-end-to-end-tests-sql/com.nimbusds-nimbus-jose-jwt-9.37.2
dependabot/maven/flink-end-to-end-tests/flink-end-to-end-tests-hive/io.netty-netty-common-4.1.115.Final
dependabot/maven/flink-connectors/flink-connector-hive/org.apache.avro-avro-1.11.4
fhueske-hotfix-add-lead_lag-table-api-agg-functions-to-docs
fhueske-FLINK-36642-backport
fhueske-FLINK-36642-Fix_SqlNames_of_builtin_functions
release-1.18
zentol-patch-3
zentol-patch-2
zentol-patch-1
release-2.0-preview1-rc1
FLINK-36437
FLINK-35580
release-1.17
release-1.19.1-rc1
FLIP-410-update3
dependabot/npm_and_yarn/flink-runtime-web/web-dashboard/express-4.19.2
dependabot/npm_and_yarn/flink-runtime-web/web-dashboard/follow-redirects-1.15.6
FLINK-34331
dependabot/npm_and_yarn/flink-runtime-web/web-dashboard/ip-2.0.1
dependabot/npm_and_yarn/flink-runtime-web/web-dashboard/follow-redirects-1.15.4
release-1.16
dependabot/npm_and_yarn/flink-runtime-web/web-dashboard/adobe/css-tools-4.3.2
revert-23801-hotfix-opdescriptor-code-smell
dependabot/maven/flink-end-to-end-tests/flink-end-to-end-tests-sql/com.squareup.okio-okio-1.17.6
dependabot/npm_and_yarn/flink-runtime-web/web-dashboard/babel/traverse-7.23.2
release-1.15
dependabot/maven/flink-connectors/flink-sql-connector-hive-3.1.3/org.apache.avro-avro-1.11.3
dependabot/maven/flink-connectors/flink-connector-hive/org.apache.avro-avro-1.11.3
dependabot/maven/flink-metrics/flink-metrics-influxdb/com.github.tomakehurst-wiremock-jre8-2.35.1
dependabot/maven/flink-end-to-end-tests/flink-sql-client-test/org.apache.kafka-kafka-clients-2.6.3
dependabot/npm_and_yarn/flink-runtime-web/web-dashboard/word-wrap-1.2.4
dependabot/maven/flink-end-to-end-tests/flink-end-to-end-tests-sql/com.squareup.okio-okio-3.4.0
1.16
dependabot/npm_and_yarn/flink-runtime-web/web-dashboard/stylelint-15.10.1
remove-kafka-connector
release-1.14
release-1.15.2-rc2
release-1.15.2-rc1
release-1.13
release-1.15.0-rc1
exp_github_actions
experiment_gha_docs
release-1.12
release-1.11
release-1.10
release-1.9
release-1.7
release-1.8
release-1.6
release-1.5
release-1.4
release-1.3
release-1.2
release-1.1
release-1.0
release-1.14.3-rc1
release-1.13.2-rc2
release-1.12.3-rc1
blink
release-1.3.3-rc2
release-1.3.3-rc1
release-1.3.2-rc3
release-1.3.2-rc2
release-1.3.2-rc1
release-1.3.1-rc2
release-1.3.1-rc1
release-1.3.0-rc3
release-1.2.1-rc2
release-1.2.1-rc1
release-1.1.5-rc1
release-0.8
release-0.9
release-0.10
release-1.2.0-rc3
release-1.1.4-rc4
release-1.1.4-rc3
release-1.1.4-rc2
release-0.7
release-0.6
release-1.1.4-rc1
release-1.1.3-rc2
release-1.1.3-rc1
release-1.1.2-rc1
release-1.1.1-rc1
release-1.1.0-rc2
release-1.1.0-rc1
release-1.0.3-rc3
release-1.0.3-rc2
release-1.0.3-rc1
release-1.0.2-rc3
release-1.0.2-rc2
release-1.0.2-rc1
release-1.0.1-rc1
release-1.0.0-rc5
release-1.0.0-rc4
release-1.0.0-rc3
release-1.0.0-rc2
release-1.0.0-rc1
release-0.10.2-rc2
release-0.10.2-rc1
release-0.10.1-rc1
release-0.10.0-rc8
release-0.10.0-rc7
release-0.10.0-rc6
release-0.10.0-rc5
release-0.10.0-rc4
release-0.10.0-rc3
release-0.10.0-rc2
release-0.10.0-rc1
release-0.10.0-rc0
release-0.10.0-milestone-1-rc1
release-0.10.0-milestone-1
release-0.9.1-rc1
release-0.9.1-rc0
release-0.9.0-rc4
release-0.9.0-rc3
release-0.9.0-rc2
release-0.9.0-rc1
release-0.9.0-milestone-1-rc1
release-0.9.0-milestone-1
release-0.5.1
release-0.5
release-0.4
release-0.8.1-rc2
release-0.8.1-rc1
release-0.8-rc3
release-0.7.0
release-0.6.2
release-0.6.1-rc0
release-0.6.1
release-0.6-rc7
release-0.5-rc1
release-0.4-rc1
release-0.4-alpha.3
release-0.4-alpha.2
release-0.4-alpha.1
release-0.4-alpha.0
release-2.0.0-rc0
release-2.0-preview1
release-2.0-preview1-rc1
release-1.20.0
release-1.20.0-rc2
release-1.20.0-rc1
release-1.20.0-rc0
release-1.19.1
release-1.19.1-rc1
release-1.19.0
release-1.19.0-rc2
release-1.19.0-rc1
release-1.18.1
release-1.18.1-rc2
release-1.18.1-rc1
release-1.16.3
release-1.17.2
release-1.16.3-rc1
release-1.17.2-rc1
release-1.18.0
release-1.18.0-rc3
release-1.18.0-rc2
release-1.18.0-rc1
release-1.18.0-rc0
release-1.17.1
release-1.16.2
release-1.17.1-rc1
release-1.16.2-rc1
release-1.17.0
release-1.17.0-rc3
release-1.15.4
release-1.17.0-rc2
release-1.15.4-rc2
release-1.17.0-rc1
release-1.15.4-rc1
release-1.16.1
release-1.16.1-rc1
release-1.15.3
release-1.15.3-rc1
release-1.16.0
release-1.16.0-rc2
release-1.16.0-rc1
release-1.14.6
release-1.16.0-rc0
release-1.14.6-rc2
release-1.14.6-rc1
release-1.15.2
release-1.15.2-rc2
release-1.15.2-rc1
release-1.15.1
release-1.14.5
release-1.15.1-rc1
release-1.14.5-rc1
release-1.15.0
release-1.15.0-rc4
release-1.15.0-rc3
release-1.15.0-rc2
release-1.15.0-rc1
release-1.15.0-rc0
release-1.14.4
release-1.14.4-rc1
release-1.13.6
release-1.13.6-rc1
release-1.14.3
release-1.14.3-rc1
release-1.11.6
release-1.12.7
release-1.14.2
release-1.13.5
release-1.12.7-rc1
release-1.11.6-rc1
release-1.13.5-rc1
release-1.14.2-rc1
release-1.14.1
release-1.13.4
release-1.12.6
release-1.11.5
release-1.12.6-rc1
release-1.14.1-rc1
release-1.13.4-rc1
release-1.11.5-rc1
release-1.13.3
release-1.13.3-rc1
release-1.14.0
release-1.14.0-rc3
release-1.14.0-rc2
release-1.14.0-rc1
release-1.14.0-rc0
release-1.11.4
release-1.12.5
release-1.13.2
release-1.12.5-rc3
release-1.13.2-rc3
release-1.11.4-rc1
release-1.12.5-rc2
release-1.13.2-rc2
release-1.12.5-rc1
release-1.13.2-rc1
release-1.13.1
release-1.13.1-rc1
release-1.12.4
release-1.12.4-rc1
release-1.12.3-rc1
release-1.13.0
release-1.13.0-rc2
release-1.13.0-rc1
release-1.13.0-rc0
release-1.12.2
release-1.12.2-rc2
release-1.10.3
release-1.10.3-rc1
release-1.12.1
release-1.12.1-rc2
release-1.12.1-rc1
release-1.11.3
release-1.11.3-rc2
release-1.11.3-rc1
release-1.12.0
release-1.12.0-rc3
release-1.12.0-rc2
release-1.12.0-rc1
release-1.11.2
release-1.11.2-rc1
release-1.10.2
release-1.10.2-rc2
release-1.10.2-rc1
release-1.11.1
release-1.11.1-rc1
release-1.11.0
release-1.11.0-rc4
release-1.11.0-rc3
release-1.11.0-rc2
release-1.11.0-rc1
release-1.10.1
release-1.10.1-rc3
release-1.10.1-rc2
release-1.10.1-rc1
release-1.9.3
release-1.9.3-rc1
release-1.10.0
release-1.10.0-rc3
release-1.10.0-rc2
release-1.9.2
release-1.10.0-rc1
release-1.9.2-rc1
release-1.8.3
release-1.8.3-rc3
release-1.8.3-rc2
release-1.8.3-rc1
release-1.9.1
release-1.9.1-rc1
release-1.8.2
release-1.8.2-rc1
release-1.9.0
release-1.9.0-rc3
release-1.9.0-rc2
release-1.8.1
release-1.8.1-rc1
release-1.8.0
release-1.8.0-rc5
release-1.8.0-rc4
release-1.8.0-rc3
release-1.8.0-rc2
release-1.8.0-rc1
release-1.6.4
release-1.7.2
release-1.6.4-rc1
release-1.7.2-rc1
release-1.6.3
release-1.5.6
release-1.7.1
release-1.6.3-rc1
release-1.5.6-rc1
release-1.7.1-rc2
release-1.7.1-rc1
release-1.7.0
release-1.7.0-rc3
release-1.7.0-rc2
release-1.7.0-rc1
release-1.6.2
release-1.5.5
release-1.6.2-rc1
release-1.5.5-rc1
release-1.5.4
release-1.6.1
release-1.5.4-rc1
release-1.6.1-rc1
release-1.5.3
release-1.5.3-rc1
release-1.6.0
release-1.6.0-rc4
release-1.6.0-rc3
release-1.6.0-rc2
release-1.5.2
release-1.5.2-rc2
release-1.5.2-rc1
release-1.6.0-rc1
release-1.5.1
release-1.5.1-rc3
release-1.5.1-rc2
release-1.5.1-rc1
release-1.5.0
release-1.5.0-rc6
release-1.5.0-rc5
release-1.5.0-rc4
release-1.5.0-rc3
release-1.5.0-rc2
release-1.3.3
release-1.4.2
release-1.4.2-rc2
release-1.4.2-rc1
release-1.4.1
release-1.4.0
release-1.4.0-rc3
release-1.4.0-rc2
release-1.4.0-rc1
release-1.3.2
release-1.3.2-rc3
release-1.3.2-rc2
release-1.3.2-rc1
release-1.1.2
release-0.8.1
release-0.7.0
release-0.8.0
release-0.6
pre-apache-rename
release-0.10.0
release-0.10.1
release-0.10.2
release-0.4
release-0.5
release-0.5-rc1
release-0.5-rc2
release-0.5-rc3
release-0.9.0
release-0.9.1
release-1.0.0
release-1.0.1
release-1.0.2
release-1.0.3
release-1.1.0
release-1.1.1
release-1.1.3
release-1.1.4
release-1.1.5
release-1.12.3
release-1.2.0
release-1.2.1
release-1.3.0
release-1.3.1
release-1.4.1-rc1
release-1.5.0-rc1
v0.4-rc1
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '24c1954ceb'
${ noResults }
flink/flink-contrib/flink-connector-wikiedits
History
jingge fff221fe5d Update version to 1.19-SNAPSHOT 1 year ago
..
src [FLINK-32670][core] Cascade deprecation to classes that implement SourceFunction 1 year ago
README.md [contrib, connector-wikiedits] Add WikipediaEditsSource 9 years ago
pom.xml Update version to 1.19-SNAPSHOT 1 year ago

README.md

flink-connector-wikiedits

A non-parallel source that parses a live stream of Wikipedia edits.

Meta data about the edits is mirrored to the IRC channel #en.wikipedia. The source establishes a connection to this IRC channel and parses the messages into WikipediaEditEvent instances.

The purpose of this source is to ease the setup of demos of the DataStream API with live data.

The original idea is from the Hello Samza project of Apache Samza. The Samza code for this is located in the samza-hello-samza repository.

Example

Add the following dependency to your project:

<dependency>
  <groupId>org.apache.flink</groupId>
  <artifactId>flink-connector-wikiedits</artifactId>
  <version>1.0-SNAPSHOT</version>
</dependency>

You can use the source like regular sources:

StreamExecutionEnvironment env = StreamExecutionEnvironment
    .getExecutionEnvironment();

DataStream<WikipediaEditEvent> edits = env
    .addSource(new WikipediaEditsSource());

Remember that it is non-parallel source and as such it will run with parallelism 1.