[go: up one dir, main page]

Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

实时数据流作业,PowerJob何时实现? #494

Open
GaoHaobo-1843 opened this issue Dec 8, 2022 · 2 comments
Open

实时数据流作业,PowerJob何时实现? #494

GaoHaobo-1843 opened this issue Dec 8, 2022 · 2 comments
Assignees
Labels
new feature new feature question Further information is requested

Comments

@GaoHaobo-1843
Copy link

看了powerjob官方文档,没找到有实时处理的处理器。就是实时任务来着,一直抓数据处理那种,一有数据就立即消费处理。

类似于ElasticJob的DataflowJob类型,提供两个接口实现那种:(fetchData) 和 (processData) ,一有业务数据会被fetchData抓取,然后processData里处理。这种场景还是很多的。

有升级这部分计划么?什么时候?

@GaoHaobo-1843 GaoHaobo-1843 added the question Further information is requested label Dec 8, 2022
@Echo009
Copy link
Member
Echo009 commented Dec 9, 2022

准确的说这个和实时没什么关系,ElasticJob 里的定义:流式作业 比较准确,只是循环取数去处理而已。

后续会考虑兼容 ElasticJob ,提供从 ElasticJob “ 无缝” 迁移到 PowerJob 的能力 ,估计要等到下下个版本(下下个月),下个版本的重点在性能优化。

@Echo009 Echo009 self-assigned this Dec 9, 2022
@Echo009 Echo009 added the new feature new feature label Dec 9, 2022
@Jamel-jun
Copy link

看了powerjob官方文档,没找到有实时处理的处理器。就是实时任务来着,一直抓数据处理那种,一有数据就立即消费处理。

类似于ElasticJob的DataflowJob类型,提供两个接口实现那种:(fetchData) 和 (processData) ,一有业务数据会被fetchData抓取,然后processData里处理。这种场景还是很多的。

有升级这部分计划么?什么时候?

这种是cdc的范畴吧,可以考虑下flink cdc,或者大数据范围内的定时调度组件。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
new feature new feature question Further information is requested
Projects
None yet
Development

No branches or pull requests

3 participants