暂无描述

Aaron Wang d5f99cc582 [E2E][Bug] Fix k8s-e2e (#15098) 1 年之前
.github d5f99cc582 [E2E][Bug] Fix k8s-e2e (#15098) 1 年之前
.idea 5b7a609a0e Add icon in idea (#12829) 2 年之前
.mvn 8c19a7776e [Improve][CI]Upgrade maven-wrapper to 3.1.0 (#8557) 3 年之前
deploy b532fe5eda [Improvement][Registry][Jdbc] Add jdbc registry config in helm charts (#14431) 1 年之前
docs 688f84452d [Feature-14678][Master][UI]Dependent task parameter passing (#14702) 1 年之前
dolphinscheduler-alert c0ed68121d [Feature-14832][Listener]Implementation of Listener Mechanism (#14981) 1 年之前
dolphinscheduler-aop 2792c45fb0 fix aop typo error (#13047) 2 年之前
dolphinscheduler-api c0ed68121d [Feature-14832][Listener]Implementation of Listener Mechanism (#14981) 1 年之前
dolphinscheduler-api-test 8020c1539c [Improvement][API Test] Add api tests for process instance (#14514) 1 年之前
dolphinscheduler-bom 5a3827eef4 [DSIP-19] Support sagemaker connections in the connection center, as well as external connections to the connection center in sagemaker tasks (#14976) 1 年之前
dolphinscheduler-common c0ed68121d [Feature-14832][Listener]Implementation of Listener Mechanism (#14981) 1 年之前
dolphinscheduler-dao c0ed68121d [Feature-14832][Listener]Implementation of Listener Mechanism (#14981) 1 年之前
dolphinscheduler-dao-plugin a5284e4024 Remove mapper usage in tools (#15073) 1 年之前
dolphinscheduler-data-quality 175d976cd2 [Feature][Data Quality] Data Quality Support Choose Database (#14406) 1 年之前
dolphinscheduler-datasource-plugin c532fea00e [Improvement] Refactoring K8S task plugin with connections managed in connection center (#14977) 1 年之前
dolphinscheduler-dist 33084d281f Add dolphinscheduler-dao-plugin module (#15019) 1 年之前
dolphinscheduler-e2e c532fea00e [Improvement] Refactoring K8S task plugin with connections managed in connection center (#14977) 1 年之前
dolphinscheduler-extract 742f0c3e60 Add workflowInstanceHost and taskInstanceHost in ITaskInstanceExecutionEvent (#14827) 1 年之前
dolphinscheduler-master c0ed68121d [Feature-14832][Listener]Implementation of Listener Mechanism (#14981) 1 年之前
dolphinscheduler-meter e86630bb7b [Improvement][Metrics] Add more worker related metrics and fix some previous ones (#14254) 1 年之前
dolphinscheduler-microbench d223d654cc Add rpc benchmark test (#14797) 1 年之前
dolphinscheduler-registry 298b8ccf5a Fix the ephemeralId will not be deleted before jdbc-registry closed. (#14936) 1 年之前
dolphinscheduler-scheduler-plugin 79cb707b57 [Improvement-13932][API] Tenant parameters and Worker group parameters are put together in the task startup parameters (#13935) 2 年之前
dolphinscheduler-service c0ed68121d [Feature-14832][Listener]Implementation of Listener Mechanism (#14981) 1 年之前
dolphinscheduler-spi c532fea00e [Improvement] Refactoring K8S task plugin with connections managed in connection center (#14977) 1 年之前
dolphinscheduler-standalone-server c0ed68121d [Feature-14832][Listener]Implementation of Listener Mechanism (#14981) 1 年之前
dolphinscheduler-storage-plugin b12df72a0c [Fix][Resource Center] Remove NONE storage type and set LOCAL type as default (#14661) 1 年之前
dolphinscheduler-task-plugin c532fea00e [Improvement] Refactoring K8S task plugin with connections managed in connection center (#14977) 1 年之前
dolphinscheduler-tools a5284e4024 Remove mapper usage in tools (#15073) 1 年之前
dolphinscheduler-ui c532fea00e [Improvement] Refactoring K8S task plugin with connections managed in connection center (#14977) 1 年之前
dolphinscheduler-worker d683553324 [Improvement][Master] Calculate the remainTime then we set the delay execution. (#15012) 1 年之前
images 8c43e71adf doc: Change readme and standalone docker quick start (#14002) 2 年之前
licenses 4bec792160 [Fix][Common] rewrite code generate,fix bit shift (#6914) 3 年之前
script 3f16776cd7 [improvement][install.sh] fix the install Error "Command not found rmr" & su… (#13163) 2 年之前
style d3f087e29b [feat][ci] Add pre-commit for easy spotless config (#12192) 2 年之前
tools b750db3c37 Add IT for dolphinscheduler-tools module (#15043) 1 年之前
.asf.yaml 68e8b352d3 Disable dependabot pull requests (#14596) 1 年之前
.dlc.json 35d8e8ac17 [Feature][DataSource] add oceanbase datasource (#13675) 2 年之前
.flake8 e90cd9e13b [release] version 3.0.3 (#13131) 2 年之前
.gitattributes d9d070974c Create .gitattributes 6 年之前
.gitignore 14ec4a2398 Remove dao module in worker (#13242) 2 年之前
.gitmodules 6a02870926 [Feature][style] Add spotless maven plugin for automatic style fix. (#11272) 2 年之前
.licenserc.yaml de6bc56aee Add Terraform deploy manifests for quick setup in AWS (#13252) 2 年之前
.pre-commit-config.yaml 1347a8f94c [chore] Separate Python API into another repository (#12779) 2 年之前
CONTRIBUTING.md 8c43e71adf doc: Change readme and standalone docker quick start (#14002) 2 年之前
LICENSE 8c19a7776e [Improve][CI]Upgrade maven-wrapper to 3.1.0 (#8557) 3 年之前
NOTICE fdb8fde776 [NOTICE]Update the NOTICE year (#14272) 1 年之前
README.md 57b9da145e [Doc]fix typo (#14691) 1 年之前
README_zh_CN.md a1bf597d0a [document]Modify the inconsistencies of grammar and wording in README_zh_CN.md (#14471) 1 年之前
doap.rdf 613bcc3b5e Add doap.rdf (#14883) 1 年之前
lombok.config d9516e2236 add lombok config (#11212) 2 年之前
mvnw 8c19a7776e [Improve][CI]Upgrade maven-wrapper to 3.1.0 (#8557) 3 年之前
mvnw.cmd 8c19a7776e [Improve][CI]Upgrade maven-wrapper to 3.1.0 (#8557) 3 年之前
pom.xml b750db3c37 Add IT for dolphinscheduler-tools module (#15043) 1 年之前

README.md

Apache Dolphinscheduler

License codecov Quality Gate Status Twitter Follow Slack Status CN doc

About

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code. It is also provided powerful user interface, dedicated to solving complex task dependencies in the data pipeline and providing various types of jobs available out of the box

The key features for DolphinScheduler are as follows:

  • Easy to deploy, provide four ways to deploy which including Standalone, Cluster, Docker and Kubernetes.
  • Easy to use, workflow can be created and managed by four ways, which including Web UI, Python SDK, Yaml file and Open API
  • Highly reliable and high availability, decentralized architecture with multi-master and multi-worker, native supports horizontal scaling.
  • High performance, its performance is N times faster than other orchestration platform and it can support tens of millions of tasks per day
  • Cloud Native, DolphinScheduler supports orchestrating multi-cloud/data center workflow, and supports custom task type
  • Versioning both workflow and workflow instance(including tasks)
  • Various state control of workflow and task, support pause/stop/recover them in any time
  • Multi-tenancy support
  • Others like backfill support(Web UI native), permission control including project, resource and data source

QuickStart

User Interface Screenshots

  • Homepage: Project and workflow overview, including the latest workflow instance and task instance status statistics. home

  • Workflow Definition: Create and manage workflow by drag and drop, easy to build and maintain complex workflow, support bulk of tasks out of box. workflow-definition

  • Workflow Tree View: Abstract tree structure could clearer understanding of the relationship between tasks workflow-tree

  • Data source: Manage support multiple external data sources, provide unified data access capabilities for such as MySQL, PostgreSQL, Hive, Trino, etc. data-source

  • Monitor: View the status of the master, worker and database in real time, including server resource usage and load, do quick health check without logging in to the server. monitor

Suggestions & Bug Reports

Follow this guide to report your suggestions or bugs.

Contributing

The community welcomes everyone to contribute, please refer to this page to find out more: How to contribute, find the good first issue in here if you are new to DolphinScheduler.

Community

Welcome to join the Apache DolphinScheduler community by:

  • Join the DolphinScheduler Slack to keep in touch with the community
  • Follow the DolphinScheduler Twitter and get the latest news
  • Subscribe DolphinScheduler mail list, users@dolphinscheduler.apache.org for user and dev@dolphinscheduler.apache.org for developer

Landscapes



  

DolphinScheduler enriches the CNCF CLOUD NATIVE Landscape.