8000 queue memory overflow · Issue #35340 · laravel/framework · GitHub
[go: up one dir, main page]
Skip to content

queue memory overflow #35340

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wenjy opened this issue Nov 24, 2020 · 2 comments
Closed

queue memory overflow #35340

wenjy opened this issue Nov 24, 2020 · 2 comments

Comments

@wenjy
Copy link
wenjy commented Nov 24, 2020
  • Laravel Version: 6.18.32
  • PHP Version: 7.3.21
  • Database Driver & Version: redis 5.3.1

Description:

queue command
artisan queue:work --queue={high},{default},{low} --tries=3

After running it for a long time

throw err

PHP Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 40960 bytes)

in symfony/console/Output/BufferedOutput.php line 39

Steps To Reproduce:

I'm debugging in symfony/console/Output/BufferedOutput.php line 39

info("buffer len->{$len}", [posix_getpid(), $this->buffer]);

see:

[2020-11-24 11:09:32] local.INFO: buffer len->4 [28858,"flux"]
[2020-11-24 11:09:32] local.INFO: buffer len->9 [28858,"flux\nflux"]
[2020-11-24 11:09:32] local.INFO: buffer len->14 [28858,"flux\nflux\niber"]
[2020-11-24 11:09:32] local.INFO: buffer len->19 [28858,"flux\nflux\niber\niber"]
[2020-11-24 11:09:53] local.INFO: buffer len->24 [28858,"flux\nflux\niber\niber\nease"]
[2020-11-24 11:09:53] local.INFO: buffer len->29 [28858,"flux\nflux\niber\niber\nease\nease"]
[2020-11-24 11:10:02] local.INFO: buffer len->34 [28858,"flux\nflux\niber\niber\nease\nease\neLog"]
[2020-11-24 11:10:02] local.INFO: buffer len->39 [28858,"flux\nflux\niber\niber\nease\nease\neLog\neLog"]
[2020-11-24 11:10:41] local.INFO: buffer len->44 [28858,"flux\nflux\niber\niber\nease\nease\neLog\neLog\nease"]
[2020-11-24 11:10:41] local.INFO: buffer len->49 [28858,"flux\nflux\niber\niber\nease\nease\neLog\neLog\nease\nease"]
[2020-11-24 11:10:41] local.INFO: buffer len->54 [28858,"flux\nflux\niber\niber\nease\nease\neLog\neLog\nease\nease\nmove"]
[2020-11-24 11:10:41] local.INFO: buffer len->59 [28858,"flux\nflux\niber\niber\nease\nease\neLog\neLog\nease\nease\nmove\nmove"]
[2020-11-24 11:10:41] local.INFO: buffer len->64 [28858,"flux\nflux\niber\niber\nease\nease\neLog\neLog\nease\nease\nmove\nmove\niber"]
[2020-11-24 11:10:41] local.INFO: buffer len->69 [28858,"flux\nflux\niber\niber\nease\nease\neLog\neLog\nease\nease\nmove\nmove\niber\niber"]
[2020-11-24 11:10:47] local.INFO: buffer len->74 [28858,"flux\nflux\niber\niber\nease\nease\neLog\neLog\nease\nease\nmove\nmove\niber\niber\nease"]
[2020-11-24 11:10:47] local.INFO: buffer len->79 [28858,"flux\nflux\niber\niber\nease\nease\neLog\neLog\nease\nease\nmove\nmove\niber\niber\nease\nease"]
[2020-11-24 11:10:56] local.INFO: buffer len->84 [28858,"flux\nflux\niber\niber\nease\nease\neLog\neLog\nease\nease\nmove\nmove\niber\niber\nease\nease\nease"]
[2020-11-24 11:10:56] local.INFO: buffer len->89 [28858,"flux\nflux\niber\niber\nease\nease\neLog\neLog\nease\nease\nmove\nmove\niber\niber\nease\nease\nease\nease"]
[2020-11-24 11:10:59] local.INFO: buffer len->94 [28858,"flux\nflux\niber\niber\nease\nease\neLog\neLog\nease\nease\nmove\nmove\niber\niber\nease\nease\nease\nease\nease"]
[2020-11-24 11:10:59] local.INFO: buffer len->99 [28858,"flux\nflux\niber\niber\nease\nease\neLog\neLog\nease\nease\nmove\nmove\niber\niber\nease\nease\nease\nease\nease\nease"]
[2020-11-24 11:11:56] local.INFO: buffer len->104 [28858,"flux\nflux\niber\niber\nease\nease\neLog\neLog\nease\nease\nmove\nmove\niber\niber\nease\nease\nease\nease\nease\nease\nflux"]
[2020-11-24 11:11:56] local.INFO: buffer len->109 [28858,"flux\nflux\niber\niber\nease\nease\neLog\neLog\nease\nease\nmove\nmove\niber\niber\nease\nease\nease\nease\nease\nease\nflux\nflux"]
[2020-11-24 11:11:56] local.INFO: buffer len->114 [28858,"flux\nflux\niber\niber\nease\nease\neLog\neLog\nease\nease\nmove\nmove\niber\niber\nease\nease\nease\nease\nease\nease\nflux\nflux\niber"]
[2020-11-24 11:11:56] local.INFO: buffer len->119 [28858,"flux\nflux\niber\niber\nease\nease\neLog\neLog\nease\nease\nmove\nmove\niber\niber\nease\nease\nease\nease\nease\nease\nflux\nflux\niber\niber"]
[2020-11-24 11:12:59] local.INFO: buffer len->124 [28858,"flux\nflux\niber\niber\nease\nease\neLog\neLog\nease\nease\nmove\nmove\niber\niber\nease\nease\nease\nease\nease\nease\nflux\nflux\niber\niber\nease"]
[2020-11-24 11:12:59] local.INFO: buffer len->129 [28858,"flux\nflux\niber\niber\nease\nease\neLog\neLog\nease\nease\nmove\nmove\niber\niber\nease\nease\nease\nease\nease\nease\nflux\nflux\niber\niber\nease\nease"]
@wenjy
Copy link
Author
wenjy commented Nov 24, 2020

https://github.com/symfony/symfony/blob/49eafee03323253328d76ec9cb4c515f94d2f202/src/Symfony/Component/Console/Style/SymfonyStyle.php#L458

I see:
// We need to know if the two last chars are PHP_EOL
// Preserve the last 4 chars inserted (PHP_EOL on windows is two chars) in the history buffer

If the message is "<info>[2020-11-24 11:17:45][b8VlqsMUOcS4wevpg1hfQB8Vs95ZTcrt] Processed: </info> xxx\\Release"

The last 4 chars ease added to the buffer

@driesvints
Copy link
Member

Seems like a Symfony issue so please open up an issue on their tracker.

@wenjy wenjy mentioned this issue Nov 24, 2020
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@driesvints @wenjy
0