Description
What version of protobuf and what language are you using?
Version: v27.0
Language: Python
What operating system (Linux, Windows, ...) and version?
Windows
What runtime / compiler are you using (e.g., python version or gcc version)
python in gitlab ci/cd
What did you do?
Steps to reproduce the behavior:
python pip install following packages:
MarkupSafe, werkzeug, click, pathspec, logbook, protobuf, pytz, Babel, text-unidecode, python-slugify, leather, six, isodate, pytimeparse, future, parsedatetime, agate, pkgutil-resolve-name, attrs, rpds-py, referencing, zipp, importlib-resources, jsonschema-specifications, jsonschema, python-dateutil, hologram, pycparser, cffi, charset-normalizer, certifi, urllib3, idna, requests, packaging, Jinja2, typing-extensions, msgpack, mashumaro, minimal-snowplow-tracker, colorama, networkx, dbt-extractor, pyyaml, sqlparse, dbt-core, googleapis-common-protos, proto-plus, pyasn1, rsa, pyasn1-modules, cachetools, google-auth, google-api-core, google-crc32c, google-cloud-core, google-resumable-media, google-cloud-storage, grpcio, grpc-google-iam-v1, google-cloud-dataproc, google-cloud-bigquery, dbt-bigquery, portalocker, platformdirs, tblib, importlib-metadata, distlib, filelock, virtualenv, isolate, isolate-proto, structlog, types-python-dateutil, grpc-interceptor, frozenlist, async-timeout, multidict, yarl, aiosignal, aiohttp, pyjwt, cryptography, auth0-python, opentelemetry-semantic-conventions, wrapt, deprecated, opentelemetry-api, opentelemetry-sdk, pydantic, datadog-api-client, dill, mdurl, markdown-it-py, pygments, rich, sniffio, h11, exceptiongroup, anyio, httpcore, httpx, starlette, fastapi, fal, backports.functools-lru-cache, backoff, monotonic, posthog, greenlet, sqlalchemy, deprecation, astor, agate-sql, numpy, pandas, dbt-fal, slack-sdk, tabulate, pyarrow, db-dtypes
What did you expect to see
compatibility with google APIs
What did you see instead?
ERROR: googleapis-common-protos 1.63.0 has requirement protobuf!=3.20.0,!=3.20.1,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<5.0.0.dev0,>=3.19.5, but you'll have protobuf 5.27.0 which is incompatible.
ERROR: proto-plus 1.23.0 has requirement protobuf<5.0.0dev,>=3.19.0, but you'll have protobuf 5.27.0 which is incompatible.
ERROR: google-api-core 2.19.0 has requirement protobuf!=3.20.0,!=3.20.1,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<5.0.0.dev0,>=3.19.5, but you'll have protobuf 5.27.0 which is incompatible.
ERROR: grpc-google-iam-v1 0.13.0 has requirement protobuf!=3.20.0,!=3.20.1,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<5.0.0dev,>=3.19.5, but you'll have protobuf 5.27.0 which is incompatible.
ERROR: google-cloud-dataproc 5.9.3 has requirement protobuf!=3.20.0,!=3.20.1,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<5.0.0dev,>=3.19.5, but you'll have protobuf 5.27.0 which is incompatible.
Make sure you include information that can help us debug (full error message, exception listing, stack trace, logs).
Full error log from gitlab ci/cd job log:
Traceback (most recent call last):
File "/usr/local/bin/dbt", line 8, in <module>
sys.exit(cli())
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1157, in __call__
return self.main(*args, **kwargs)
File "/usr/local/lib/python3.8/site-packages/click/core.py", lin
7171
e 1077, in main
with self.make_context(prog_name, args, **extra) as ctx:
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 943, in make_context
self.parse_args(ctx, args)
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1644, in parse_args
rest = super().parse_args(ctx, args)
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1408, in parse_args
value, args = param.handle_parse_result(ctx, opts, args)
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 2400, in handle_parse_result
value = self.process_value(ctx, value)
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 2362, in process_value
value = self.callback(ctx, self, value)
File "/usr/local/lib/python3.8/site-packages/dbt/cli/params.py", line 500, in _version_callback
click.echo(get_version_information())
File "/usr/local/lib/python3.8/site-packages/dbt/version.py", line 24, in get_version_information
plugin_version_msg = _get_plugins_msg(installed)
File "/usr/local/lib/python3.8/site-packages/dbt/version.py", line 104, in _get_plugins_msg
for name, version_s in _get_dbt_plugins_info():
File "/usr/local/lib/python3.8/site-packages/dbt/version.py", line 211, in _get_dbt_plugins_info
mod = importlib.import_module(f"dbt.adapters.{plugin_name}.__version__")
File "/usr/local/lib/python3.8/importlib/__init__.py", line 127, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "<frozen importlib._bootstrap>", line [1014](https://gitlab.com/spigotinc/mobile/dbt/ios-eet/-/jobs/6924644813#L1014), in _gcd_import
File "<frozen importlib._bootstrap>", line 991, in _find_and_load
File "<frozen importlib._bootstrap>", line 961, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
File "<frozen importlib._bootstrap>", line 991, in _find_and_load
File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 671, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 783, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/usr/local/lib/python3.8/site-packages/dbt/adapters/bigquery/__init__.py", line 5, in <module>
from dbt.adapters.bigquery.impl import BigQueryAdapter, GrantTarget # noqa
File "/usr/local/lib/python3.8/site-packages/dbt/adapters/bigquery/impl.py", line 30, in <module>
from dbt.adapters.bigquery.python_submissions import (
File "/usr/local/lib/python3.8/site-packages/dbt/adapters/bigquery/python_submissions.py", line 8, in <module>
from google.cloud import storage, dataproc_v1 # type: ignore
File "/usr/local/lib/python3.8/site-packages/google/cloud/dataproc_v1/__init__.py", line 21, in <module>
from .services.autoscaling_policy_service import (
File "/usr/local/lib/python3.8/site-packages/google/cloud/dataproc_v1/services/autoscaling_policy_service/__init__.py", line 16, in <module>
from .async_client import AutoscalingPolicyServiceAsyncClient
File "/usr/local/lib/python3.8/site-packages/google/cloud/dataproc_v1/services/autoscaling_policy_service/async_client.py", line 49, in <module>
from google.cloud.dataproc_v1.services.autoscaling_policy_service import pagers
File "/usr/local/lib/python3.8/site-packages/google/cloud/dataproc_v1/services/autoscaling_policy_service/pagers.py", line 27, in <module>
from google.cloud.dataproc_v1.types import autoscaling_policies
File "/usr/local/lib/python3.8/site-packages/google/cloud/dataproc_v1/types/__init__.py", line 16, in <module>
from .autoscaling_policies import (
File "/usr/local/lib/python3.8/site-packages/google/cloud/dataproc_v1/types/autoscaling_policies.py", line 21, in <module>
import proto # type: ignore
File "/usr/local/lib/python3.8/site-packages/proto/__init__.py", line 15, in <module>
from .enums import Enum
File "/usr/local/lib/python3.8/site-packages/proto/enums.py", line 19, in <module>
from proto import _file_info
File "/usr/local/lib/python3.8/site-packages/proto/_file_info.py", line 24, in <module>
from proto.marshal.rules.message import MessageRule
File "/usr/local/lib/python3.8/site-packages/proto/marshal/__init__.py", line 15, in <module>
from .marshal import Marshal
File "/usr/local/lib/python3.8/site-packages/proto/marshal/marshal.py", line 25, in <module>
from proto.marshal import compat
File "/usr/local/lib/python3.8/site-packages/proto/marshal/compat.py", line 43, in <module>
map_composite_types += (_message.MessageMapContainer,)
AttributeError: module 'google._upb._message' has no attribute 'MessageMapContainer'
Anything else we should know about your project / environment
using docker image python:3.8.1-slim-buster