Sen descrición

liyou b451d64696 resource file manager page,repeat onMounted optimize (#14011) %!s(int64=2) %!d(string=hai) anos
.github f9f88cb505 doc: Add hyperlink for pydolphinscheduler doc (#13907) %!s(int64=2) %!d(string=hai) anos
.idea 5b7a609a0e Add icon in idea (#12829) %!s(int64=2) %!d(string=hai) anos
.mvn 8c19a7776e [Improve][CI]Upgrade maven-wrapper to 3.1.0 (#8557) %!s(int64=3) %!d(string=hai) anos
deploy 0a5b32e8b6 [Improvement-13785][docker] upgrade zk and pg image version to support arm architecture (#13789) %!s(int64=2) %!d(string=hai) anos
docs 8c43e71adf doc: Change readme and standalone docker quick start (#14002) %!s(int64=2) %!d(string=hai) anos
dolphinscheduler-alert 81aa105ff6 [Fix-13820][alert] Fix bodyParams is empty get error log (#13821) %!s(int64=2) %!d(string=hai) anos
dolphinscheduler-aop 2792c45fb0 fix aop typo error (#13047) %!s(int64=2) %!d(string=hai) anos
dolphinscheduler-api db6c061c8b [Feature][plugin] Add databend datasource in datasource plugin (#13866) %!s(int64=2) %!d(string=hai) anos
dolphinscheduler-api-test 2dceb6b8ca [Feature-13428][Resource Center] Add support for Google Cloud Storage in the resource center (#13562) %!s(int64=2) %!d(string=hai) anos
dolphinscheduler-bom db6c061c8b [Feature][plugin] Add databend datasource in datasource plugin (#13866) %!s(int64=2) %!d(string=hai) anos
dolphinscheduler-common db6c061c8b [Feature][plugin] Add databend datasource in datasource plugin (#13866) %!s(int64=2) %!d(string=hai) anos
dolphinscheduler-dao fba47b337e [BUG][Data Quality] Fixing the incorrect DML statements in upgrade SQL. (#13960) %!s(int64=2) %!d(string=hai) anos
dolphinscheduler-data-quality db6c061c8b [Feature][plugin] Add databend datasource in datasource plugin (#13866) %!s(int64=2) %!d(string=hai) anos
dolphinscheduler-datasource-plugin db6c061c8b [Feature][plugin] Add databend datasource in datasource plugin (#13866) %!s(int64=2) %!d(string=hai) anos
dolphinscheduler-dist db6c061c8b [Feature][plugin] Add databend datasource in datasource plugin (#13866) %!s(int64=2) %!d(string=hai) anos
dolphinscheduler-e2e 26c5f3cac4 [E2E-Test] Try to fix flaky e2e test (#13971) %!s(int64=2) %!d(string=hai) anos
dolphinscheduler-master d617620b00 [improve-#13956] taskId is null (#13980) %!s(int64=2) %!d(string=hai) anos
dolphinscheduler-meter 394805b2c7 [Feature][Metrics] Tag workflow related metrics with process definition code (workflow id) (#13640) %!s(int64=2) %!d(string=hai) anos
dolphinscheduler-microbench 8d12dc0702 [Improvement-13491] Use lombok @Slf4j annotation to generate logger (#13509) %!s(int64=2) %!d(string=hai) anos
dolphinscheduler-registry 41a8ba9aab Support alert server HA (#13865) %!s(int64=2) %!d(string=hai) anos
dolphinscheduler-remote 79cb707b57 [Improvement-13932][API] Tenant parameters and Worker group parameters are put together in the task startup parameters (#13935) %!s(int64=2) %!d(string=hai) anos
dolphinscheduler-scheduler-plugin 79cb707b57 [Improvement-13932][API] Tenant parameters and Worker group parameters are put together in the task startup parameters (#13935) %!s(int64=2) %!d(string=hai) anos
dolphinscheduler-service 45586f71d5 [BUG][Resource Center] Task can not select main JAR (#13536) %!s(int64=2) %!d(string=hai) anos
dolphinscheduler-spi db6c061c8b [Feature][plugin] Add databend datasource in datasource plugin (#13866) %!s(int64=2) %!d(string=hai) anos
dolphinscheduler-standalone-server 61a689aa5a Use percentage to represent memory/cpu usage (#13896) %!s(int64=2) %!d(string=hai) anos
dolphinscheduler-storage-plugin 3305d6d127 [Improvement-13804] Optimal HDFS configuration acquisition (#13804) (#13811) %!s(int64=2) %!d(string=hai) anos
dolphinscheduler-task-plugin db6c061c8b [Feature][plugin] Add databend datasource in datasource plugin (#13866) %!s(int64=2) %!d(string=hai) anos
dolphinscheduler-tools 79cb707b57 [Improvement-13932][API] Tenant parameters and Worker group parameters are put together in the task startup parameters (#13935) %!s(int64=2) %!d(string=hai) anos
dolphinscheduler-ui b451d64696 resource file manager page,repeat onMounted optimize (#14011) %!s(int64=2) %!d(string=hai) anos
dolphinscheduler-worker f6e0f2e471 [Bug] [worker] WorkerConfig output is wrong (#14000) (#14001) %!s(int64=2) %!d(string=hai) anos
images 8c43e71adf doc: Change readme and standalone docker quick start (#14002) %!s(int64=2) %!d(string=hai) anos
licenses 4bec792160 [Fix][Common] rewrite code generate,fix bit shift (#6914) %!s(int64=3) %!d(string=hai) anos
script 3f16776cd7 [improvement][install.sh] fix the install Error "Command not found rmr" & su… (#13163) %!s(int64=2) %!d(string=hai) anos
style d3f087e29b [feat][ci] Add pre-commit for easy spotless config (#12192) %!s(int64=2) %!d(string=hai) anos
tools db6c061c8b [Feature][plugin] Add databend datasource in datasource plugin (#13866) %!s(int64=2) %!d(string=hai) anos
.asf.yaml 8c43e71adf doc: Change readme and standalone docker quick start (#14002) %!s(int64=2) %!d(string=hai) anos
.dlc.json 35d8e8ac17 [Feature][DataSource] add oceanbase datasource (#13675) %!s(int64=2) %!d(string=hai) anos
.flake8 e90cd9e13b [release] version 3.0.3 (#13131) %!s(int64=2) %!d(string=hai) anos
.gitattributes d9d070974c Create .gitattributes %!s(int64=6) %!d(string=hai) anos
.gitignore 14ec4a2398 Remove dao module in worker (#13242) %!s(int64=2) %!d(string=hai) anos
.gitmodules 6a02870926 [Feature][style] Add spotless maven plugin for automatic style fix. (#11272) %!s(int64=2) %!d(string=hai) anos
.licenserc.yaml de6bc56aee Add Terraform deploy manifests for quick setup in AWS (#13252) %!s(int64=2) %!d(string=hai) anos
.pre-commit-config.yaml 1347a8f94c [chore] Separate Python API into another repository (#12779) %!s(int64=2) %!d(string=hai) anos
CONTRIBUTING.md 8c43e71adf doc: Change readme and standalone docker quick start (#14002) %!s(int64=2) %!d(string=hai) anos
LICENSE 8c19a7776e [Improve][CI]Upgrade maven-wrapper to 3.1.0 (#8557) %!s(int64=3) %!d(string=hai) anos
NOTICE deb1624c3e Update NOTICE year (#7784) %!s(int64=3) %!d(string=hai) anos
README.md 8c43e71adf doc: Change readme and standalone docker quick start (#14002) %!s(int64=2) %!d(string=hai) anos
README_zh_CN.md 8c43e71adf doc: Change readme and standalone docker quick start (#14002) %!s(int64=2) %!d(string=hai) anos
lombok.config d9516e2236 add lombok config (#11212) %!s(int64=2) %!d(string=hai) anos
mvnw 8c19a7776e [Improve][CI]Upgrade maven-wrapper to 3.1.0 (#8557) %!s(int64=3) %!d(string=hai) anos
mvnw.cmd 8c19a7776e [Improve][CI]Upgrade maven-wrapper to 3.1.0 (#8557) %!s(int64=3) %!d(string=hai) anos
pom.xml 41801663fd [Improvement] Remove duplicate dependencies (#13773) %!s(int64=2) %!d(string=hai) anos

README.md

Apache Dolphinscheduler

License codecov Quality Gate Status Twitter Follow Slack Status CN doc

About

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code. It is also provided powerful user interface, dedicated to solving complex task dependencies in the data pipeline and providing various types of jobs available out of the box

The key features for DolphinScheduler are as follows:

  • Easy to deploy, provide four ways to deploy which including Standalone, Cluster, Docker and Kubernetes.
  • Easy to use, workflow can be created and managed by four ways, which including Web UI, Python SDK, Yaml file and Open API
  • Highly reliable and high availability, decentralized architecture with multi-master and multi-worker, native supports horizontal scaling.
  • High performance, its performance is N times faster than other orchestration platform and it can support tens of millions of tasks per day
  • Cloud Native, DolphinScheduler supports orchestrating multi-cloud/data center workflow, and supports custom task type
  • Versioning both workflow and workflow instance(including tasks)
  • Various state control of workflow and task, support pause/stop/recover them in any time
  • Multi-tenancy support
  • Others like backfill support(Web UI native), permission control including project, resource and data source

QuickStart

User Interface Screenshots

  • Homepage: Project and workflow overview, including the latest workflow instance and task instance status statistics. home

  • Workflow Definition: Create and manage workflow by drag and drop, easy to build and maintain complex workflow, support bulk of tasks out of box. workflow-definition

  • Workflow Tree View: Abstract tree structure could clearer understanding of the relationship between tasks workflow-tree

  • Data source: Manage support multiple external data sources, provide unified data access capabilities for such as MySQL, PostgreSQL, Hive, Trino, etc. data-source

  • Monitor: View the status of the master, worker and database in real time, including server resource usage and load, do quick health check without logging in to the server. monitor

Suggestions & Bug Reports

Follow this guide to report your suggestions or bugs.

Contributing

The community welcomes everyone to contribute, please refer to this page to find out more: How to contribute, find the good first issue in here if you are new to DolphinScheduler.

Community

Welcome to join the Apache DolphinScheduler community by:

  • Join the DolphinScheduler Slack to keep in touch with the community
  • Follow the DolphinScheduler Twitter and get the latest news
  • Subscribe DolphinScheduler mail list, users@dolphinscheduler.apache.org for user and dev@dolphinscheduler.apache.org for developer

Landscapes



  

DolphinScheduler enriches the CNCF CLOUD NATIVE Landscape.