No Description

Jay Chung 898b001608 cp: Reduce the size of tarball to continue ASF release (#15004) (#15540) 1 year ago
.github 67615bd815 chore: Docs change for 3.2.1 release (#15539) 1 year ago
.idea 5b7a609a0e Add icon in idea (#12829) 2 years ago
.mvn 8c19a7776e [Improve][CI]Upgrade maven-wrapper to 3.1.0 (#8557) 3 years ago
deploy 67615bd815 chore: Docs change for 3.2.1 release (#15539) 1 year ago
docs 67615bd815 chore: Docs change for 3.2.1 release (#15539) 1 year ago
dolphinscheduler-alert 898b001608 cp: Reduce the size of tarball to continue ASF release (#15004) (#15540) 1 year ago
dolphinscheduler-aop 2792c45fb0 fix aop typo error (#13047) 2 years ago
dolphinscheduler-api 898b001608 cp: Reduce the size of tarball to continue ASF release (#15004) (#15540) 1 year ago
dolphinscheduler-api-test 898b001608 cp: Reduce the size of tarball to continue ASF release (#15004) (#15540) 1 year ago
dolphinscheduler-bom bf2cdc5300 Use Druid to split sql (#15367) 1 year ago
dolphinscheduler-common 64e1e67581 Use DefaultUncaughtExceptionHandler to log the uncached exception (#15496) 1 year ago
dolphinscheduler-dao 67615bd815 chore: Docs change for 3.2.1 release (#15539) 1 year ago
dolphinscheduler-dao-plugin a5284e4024 Remove mapper usage in tools (#15073) 1 year ago
dolphinscheduler-data-quality 175d976cd2 [Feature][Data Quality] Data Quality Support Choose Database (#14406) 1 year ago
dolphinscheduler-datasource-plugin cb5317f7ca [bug] Exception when using host in ipv6 format (#14040) 1 year ago
dolphinscheduler-dist 898b001608 cp: Reduce the size of tarball to continue ASF release (#15004) (#15540) 1 year ago
dolphinscheduler-e2e 3c7a77c90e [Improvement][E2E] add e2e javatask case (#15469) 1 year ago
dolphinscheduler-extract 86ef9666c4 Fix exception occur in RpcServer side, it will not be sent to RpcClient (#15536) 1 year ago
dolphinscheduler-master 898b001608 cp: Reduce the size of tarball to continue ASF release (#15004) (#15540) 1 year ago
dolphinscheduler-meter 7b9c9e0eb2 Enable set ServerLoadProtection fot Master/Worker (#15439) 1 year ago
dolphinscheduler-microbench d6dea4633c Optimize server startup log (#15362) 1 year ago
dolphinscheduler-registry 6aa6e114a5 [Improvement][Alert] Add a test send feature when creating an alert instance (#15163) 1 year ago
dolphinscheduler-scheduler-plugin 79cb707b57 [Improvement-13932][API] Tenant parameters and Worker group parameters are put together in the task startup parameters (#13935) 1 year ago
dolphinscheduler-service 44c356db4d TaskGroupPriority only compare When TaskGroup is same (#15486) 1 year ago
dolphinscheduler-spi c532fea00e [Improvement] Refactoring K8S task plugin with connections managed in connection center (#14977) 1 year ago
dolphinscheduler-standalone-server 7b9c9e0eb2 Enable set ServerLoadProtection fot Master/Worker (#15439) 1 year ago
dolphinscheduler-storage-plugin 898b001608 cp: Reduce the size of tarball to continue ASF release (#15004) (#15540) 1 year ago
dolphinscheduler-task-plugin 898b001608 cp: Reduce the size of tarball to continue ASF release (#15004) (#15540) 1 year ago
dolphinscheduler-tools 898b001608 cp: Reduce the size of tarball to continue ASF release (#15004) (#15540) 1 year ago
dolphinscheduler-ui 3640a28348 [Improvement][HTTP] support custom rendering of http body (#15531) 1 year ago
dolphinscheduler-worker 64e1e67581 Use DefaultUncaughtExceptionHandler to log the uncached exception (#15496) 1 year ago
images 8c43e71adf doc: Change readme and standalone docker quick start (#14002) 1 year ago
licenses 4bec792160 [Fix][Common] rewrite code generate,fix bit shift (#6914) 3 years ago
script 3f16776cd7 [improvement][install.sh] fix the install Error "Command not found rmr" & su… (#13163) 2 years ago
style d3f087e29b [feat][ci] Add pre-commit for easy spotless config (#12192) 2 years ago
tools 898b001608 cp: Reduce the size of tarball to continue ASF release (#15004) (#15540) 1 year ago
.asf.yaml 68e8b352d3 Disable dependabot pull requests (#14596) 1 year ago
.dlc.json 35d8e8ac17 [Feature][DataSource] add oceanbase datasource (#13675) 2 years ago
.flake8 e90cd9e13b [release] version 3.0.3 (#13131) 2 years ago
.gitattributes d9d070974c Create .gitattributes 6 years ago
.gitignore 14ec4a2398 Remove dao module in worker (#13242) 2 years ago
.gitmodules 6a02870926 [Feature][style] Add spotless maven plugin for automatic style fix. (#11272) 2 years ago
.licenserc.yaml 1c1d4bd592 [Improvement][Helm] using helm-docs to generate docs automatically (#15299) 1 year ago
.pre-commit-config.yaml 1347a8f94c [chore] Separate Python API into another repository (#12779) 2 years ago
CONTRIBUTING.md 8c43e71adf doc: Change readme and standalone docker quick start (#14002) 1 year ago
LICENSE 8c19a7776e [Improve][CI]Upgrade maven-wrapper to 3.1.0 (#8557) 3 years ago
NOTICE fdb8fde776 [NOTICE]Update the NOTICE year (#14272) 1 year ago
README.md e00121b44b Add guideline link into DolphinScheduler mail list (#15447) 1 year ago
README_zh_CN.md e00121b44b Add guideline link into DolphinScheduler mail list (#15447) 1 year ago
doap.rdf 613bcc3b5e Add doap.rdf (#14883) 1 year ago
lombok.config d9516e2236 add lombok config (#11212) 2 years ago
mvnw 8c19a7776e [Improve][CI]Upgrade maven-wrapper to 3.1.0 (#8557) 3 years ago
mvnw.cmd 8c19a7776e [Improve][CI]Upgrade maven-wrapper to 3.1.0 (#8557) 3 years ago
pom.xml 898b001608 cp: Reduce the size of tarball to continue ASF release (#15004) (#15540) 1 year ago

README.md

Apache Dolphinscheduler

License codecov Quality Gate Status Twitter Follow Slack Status CN doc

About

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code. It is also provided powerful user interface, dedicated to solving complex task dependencies in the data pipeline and providing various types of jobs available out of the box

The key features for DolphinScheduler are as follows:

  • Easy to deploy, provide four ways to deploy which including Standalone, Cluster, Docker and Kubernetes.
  • Easy to use, workflow can be created and managed by four ways, which including Web UI, Python SDK, Yaml file and Open API
  • Highly reliable and high availability, decentralized architecture with multi-master and multi-worker, native supports horizontal scaling.
  • High performance, its performance is N times faster than other orchestration platform and it can support tens of millions of tasks per day
  • Cloud Native, DolphinScheduler supports orchestrating multi-cloud/data center workflow, and supports custom task type
  • Versioning both workflow and workflow instance(including tasks)
  • Various state control of workflow and task, support pause/stop/recover them in any time
  • Multi-tenancy support
  • Others like backfill support(Web UI native), permission control including project, resource and data source

QuickStart

User Interface Screenshots

  • Homepage: Project and workflow overview, including the latest workflow instance and task instance status statistics. home

  • Workflow Definition: Create and manage workflow by drag and drop, easy to build and maintain complex workflow, support bulk of tasks out of box. workflow-definition

  • Workflow Tree View: Abstract tree structure could clearer understanding of the relationship between tasks workflow-tree

  • Data source: Manage support multiple external data sources, provide unified data access capabilities for such as MySQL, PostgreSQL, Hive, Trino, etc. data-source

  • Monitor: View the status of the master, worker and database in real time, including server resource usage and load, do quick health check without logging in to the server. monitor

Suggestions & Bug Reports

Follow this guide to report your suggestions or bugs.

Contributing

The community welcomes everyone to contribute, please refer to this page to find out more: How to contribute, find the good first issue in here if you are new to DolphinScheduler.

Community

Welcome to join the Apache DolphinScheduler community by:

Landscapes



  

DolphinScheduler enriches the CNCF CLOUD NATIVE Landscape.