8000 Add database worker job logging by abnegate · Pull Request #10056 · appwrite/appwrite · GitHub
[go: up one dir, main page]

Skip to content

Conversation

@abnegate
Copy link
Member

What does this PR do?

(Provide a description of what this PR does and why it's needed.)

Test Plan

(Write your test plan here. If you changed any code, please provide us with clear instructions on how you verified your changes work. Screenshots may also be helpful.)

Related PRs and Issues

  • (Related PR or issue)

Checklist

  • Have you read the Contributing Guidelines on issues?
  • If the PR includes a change to an API's metadata (desc, label, params, etc.), does it also include updated API specs and example docs?

@coderabbitai
Copy link
Contributor
coderabbitai bot commented Jun 25, 2025

Warning

Rate limit exceeded

@abnegate has exceeded the limit for the number of commits or files that can be reviewed per hour. Please wait 16 minutes and 38 seconds before requesting another review.

⌛ How to resolve this issue?

After the wait time has elapsed, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

We recommend that you space out your commits to avoid hitting the rate limit.

🚦 How do rate limits work?

CodeRabbit enforces hourly rate limits for each developer per organization.

Our paid plans have higher rate limits than the trial, open-source and free plans. In all cases, we re-allow further reviews after a brief timeout.

Please see our FAQ for further information.

📥 Commits

Reviewing files that changed from the base of the PR and between 620266d and 7508a22.

⛔ Files ignored due to path filters (1)
  • composer.lock is excluded by !**/*.lock
📒 Files selected for processing (1)
  • src/Appwrite/Platform/Workers/Databases.php (3 hunks)
📝 Walkthrough

Walkthrough

The changes add informational logging to database-related operations in multiple components. In the Databases worker class, JSON-formatted logs are output before and after executing database operations, detailing operation type and relevant IDs. The API shutdown hook logs database event details before triggering the event. A new public getter method getDatabase() is added to the Database event class, returning the associated database document. The CI workflow updates correct flag syntax for the oha benchmarking tool by replacing --output_format with --output-format. No core logic, error handling, or control flow changes are made.

Suggested reviewers

  • Meldiron
✨ Finishing Touches
  • 📝 Generate Docstrings

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share
🪧 Tips

Chat

There are 3 ways to chat with CodeRabbit:

  • Review comments: Directly reply to a review comment made by CodeRabbit. Example:
    • I pushed a fix in commit <commit_id>, please review it.
    • Explain this complex logic.
    • Open a follow-up GitHub issue for this discussion.
  • Files and specific lines of code (under the "Files changed" tab): Tag @coderabbitai in a new review comment at the desired location with your query. Examples:
    • @coderabbitai explain this code block.
    • @coderabbitai modularize this function.
  • PR comments: Tag @coderabbitai in a new PR comment to ask questions about the PR branch. For the best results, please provide a very specific query, as very limited context is provided in this mode. Examples:
    • @coderabbitai gather interesting stats about this repository and render them as a table. Additionally, render a pie chart showing the language distribution in the codebase.
    • @coderabbitai read src/utils.ts and explain its main purpose.
    • @coderabbitai read the files in the src/scheduler package and generate a class diagram using mermaid and a README in the markdown format.
    • @coderabbitai help me debug CodeRabbit configuration file.

Support

Need help? Create a ticket on our support page for assistance with any issues or questions.

Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments.

CodeRabbit Commands (Invoked using PR comments)

  • @coderabbitai pause to pause the reviews on a PR.
  • @coderabbitai resume to resume the paused reviews.
  • @coderabbitai review to trigger an incremental review. This is useful when automatic reviews are disabled for the repository.
  • @coderabbitai full review to do a full review from scratch and review all the files again.
  • @coderabbitai summary to regenerate the summary of the PR.
  • @coderabbitai generate docstrings to generate docstrings for this PR.
  • @coderabbitai generate sequence diagram to generate a sequence diagram of the changes in this PR.
  • @coderabbitai resolve resolve all the CodeRabbit review comments.
  • @coderabbitai configuration to show the current CodeRabbit configuration for the repository.
  • @coderabbitai help to get help.

Other keywords and placeholders

  • Add @coderabbitai ignore anywhere in the PR description to prevent this PR from being reviewed.
  • Add @coderabbitai summary to generate the high-level summary at a specific location in the PR description.
  • Add @coderabbitai anywhere in the PR title to generate the title automatically.

Documentation and Community

  • Visit our Documentation for detailed information on how to use CodeRabbit.
  • Join our Discord Community to get help, request features, and share feedback.
  • Follow us on X/Twitter for updates and announcements.

@github-actions
Copy link
github-actions bot commented Jun 25, 2025

Security Scan Results for PR

Docker Image Scan Results

Package Version Vulnerability Severity
binutils 2.42-r0 CVE-2025-0840 HIGH
libexpat 2.6.4-r0 CVE-2024-8176 HIGH
libxml2 2.12.7-r0 CVE-2024-56171 HIGH
libxml2 2.12.7-r0 CVE-2025-24928 HIGH
libxml2 2.12.7-r0 CVE-2025-27113 HIGH
libxml2 2.12.7-r0 CVE-2025-32414 HIGH
libxml2 2.12.7-r0 CVE-2025-32415 HIGH
pyc 3.12.9-r0 CVE-2024-12718 HIGH
pyc 3.12.9-r0 CVE-2025-4138 HIGH
pyc 3.12.9-r0 CVE-2025-4517 HIGH
python3 3.12.9-r0 CVE-2024-12718 HIGH
python3 3.12.9-r0 CVE-2025-4138 HIGH
python3 3.12.9-r0 CVE-2025-4517 HIGH
python3-pyc 3.12.9-r0 CVE-2024-12718 HIGH
python3-pyc 3.12.9-r0 CVE-2025-4138 HIGH
python3-pyc 3.12.9-r0 CVE-2025-4517 HIGH
python3-pycache-pyc0 3.12.9-r0 CVE-2024-12718 HIGH
python3-pycache-pyc0 3.12.9-r0 CVE-2025-4138 HIGH
python3-pycache-pyc0 3.12.9-r0 CVE-2025-4517 HIGH
sqlite-libs 3.45.3-r1 CVE-2025-29087 HIGH
xz 5.6.2-r0 CVE-2025-31115 HIGH
xz-libs 5.6.2-r0 CVE-2025-31115 HIGH
golang.org/x/crypto v0.31.0 CVE-2025-22869 HIGH

Source Code Scan Results

🎉 No vulnerabilities found!

Copy link
Contributor
@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🧹 Nitpick comments (2)
src/Appwrite/Platform/Workers/Databases.php (2)

72-78: Review logging verbosity and sensitive data exposure.

The detailed operation logging provides good observability but may be too verbose for production and exposes potentially sensitive IDs.

Consider these improvements:

  1. Make logging level configurable:
-        Console::info("Processing database operation: \n" . \json_encode([
+        if (App::getEnv('_APP_LOGGING_VERBOSE', 'false') === 'true') {
+            Console::info("Processing database operation: \n" . \json_encode([
                 'type' => $type,
                 'projectId' => $project->getId(),
                 'databaseId' => $database->getId(),
                 'collectionId' => $collection->getId(),
                 'documentId' => $document->getId(),
-        ], JSON_PRETTY_PRINT));
+            ], JSON_PRETTY_PRINT));
+        }
  1. Consider structured logging:
    Use the injected $log parameter for structured logging instead of Console::info() for better log management and filtering capabilities.

99-105: Consider consolidating redundant logging and adding timing information.

The post-operation log contains identical information to the pre-operation log, which may be redundant. Consider adding execution timing or operation status.

Consider these improvements:

  1. Add timing and reduce redundancy:
+        $operationStart = microtime(true);
         // ... existing operation logic ...
         
-        Console::info("Finished processing database operation: \n" . \json_encode([
-            'type' => $type,
-            'projectId' => $project->getId(),
-            'databaseId' => $database->getId(),
-            'collectionId' => $collection->getId(),
-            'documentId' => $document->getId(),
-        ], JSON_PRETTY_PRINT));
+        if (App::getEnv('_APP_LOGGING_VERBOSE', 'false') === 'true') {
+            $executionTime = microtime(true) - $operationStart;
+            Console::info("Completed database operation in {$executionTime}s: {$type}");
+        }
  1. Add error context:
    Consider logging operation status (success/failure) and any relevant metrics.
📜 Review details

Configuration used: .coderabbit.yaml
Review profile: CHILL
Plan: Pro

📥 Commits

Reviewing files that changed from the base of the PR and between 3fae6ae and 92a0453.

📒 Files selected for processing (1)
  • src/Appwrite/Platform/Workers/Databases.php (4 hunks)
⏰ Context from checks skipped due to timeout of 90000ms (3)
  • GitHub Check: Setup & Build Appwrite Image
  • GitHub Check: Setup & Build Appwrite Image
  • GitHub Check: scan
🔇 Additional comments (1)
src/Appwrite/Platform/Workers/Databases.php (1)

7-7: Import addition looks correct.

The Swoole\Timer import is properly added to support the timer functionality used in the constructor.

Copy link
Contributor
@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 0

🧹 Nitpick comments (1)
app/controllers/shared/api.php (1)

801-804: Consider removing unnecessary newline character in log message.

The logging implementation looks good with structured JSON output containing relevant context. However, the explicit newline character in the log message might be redundant since Console::info() likely handles line formatting automatically.

Consider this refinement:

-            Console::info("Triggering database event: \n" .  \json_encode([
+            Console::info("Triggering database event: " . \json_encode([
                'type' => $queueForDatabase->getType(),
                'project' => $project->getId(),
            ]));
📜 Review details

Configuration used: .coderabbit.yaml
Review profile: CHILL
Plan: Pro

📥 Commits

Reviewing files that changed from the base of the PR and between 92a0453 and d7d7fa3.

📒 Files selected for processing (1)
  • app/controllers/shared/api.php (2 hunks)
⏰ Context from checks skipped due to timeout of 90000ms (15)
  • GitHub Check: E2E Service Test (Users)
  • GitHub Check: E2E Service Test (Projects)
  • GitHub Check: E2E Service Test (Sites)
  • GitHub Check: E2E Service Test (Databases)
  • GitHub Check: E2E Service Test (Locale)
  • GitHub Check: E2E Service Test (GraphQL)
  • GitHub Check: E2E Service Test (FunctionsSchedule)
  • GitHub Check: E2E Service Test (Console)
  • GitHub Check: E2E Service Test (Account)
  • GitHub Check: E2E Service Test (Avatars)
  • GitHub Check: E2E Service Test (Dev Keys)
  • GitHub Check: Unit Test
  • GitHub Check: E2E General Test
  • GitHub Check: Setup & Build Appwrite Image
  • GitHub Check: scan
🔇 Additional comments (1)
app/controllers/shared/api.php (1)

25-25: LGTM: Console import added correctly.

The import is necessary for the Console::info() usage in the logging code and follows PHP import conventions.

@github-actions
Copy link
github-actions bot commented Jun 25, 2025

✨ Benchmark results

  • Requests per second: 883
  • Requests with 200 status code: 159,043
  • P99 latency: 0.211771626

⚡ Benchmark Comparison

Metric This PR Latest version
RPS 883 1,069
200 159,043 192,535
P99 0.211771626 0.176665891

@abnegate abnegate merged commit e8982e6 into 1.7.x Jun 25, 2025
65 of 66 checks passed
@abnegate abnegate deleted the feat-update-logging branch June 25, 2025 22:00
@coderabbitai coderabbitai bot mentioned this pull request Aug 27, 2025
2 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

0