Confluent JDBC output connector does not work #2954
-
|
Thank you always. I installed Docker on Ubuntu and ran the Feldera Platform. Is there something wrong with the setting?
docker compose -f deploy/docker-compose.yml \
-f deploy/docker-compose-dev.yml \
-f deploy/docker-compose-extra.yml \
--profile postgres --profile kafka-connect up --build
CREATE TABLE my_table1 (
id bigint not null primary key,
part bigint not null,
vendor bigint not null,
price integer
) WITH ('materialized' = 'true');
CREATE VIEW my_view
WITH (
'connectors' = '[{
"transport": {
"name": "kafka_output",
"config": {
"bootstrap.servers": "redpanda:9092",
"topic": "my_table1"
}
},
"format": {
"name": "avro",
"config": {
"update_format": "confluent_jdbc",
"registry_urls": ["http://redpanda:8081"],
"key_fields": ["id"]
}
},
}]'
)
AS SELECT * FROM my_table1;&
|
Beta Was this translation helpful? Give feedback.
Answered by
mihaibudiu
Nov 14, 2024
Replies: 3 comments 1 reply
-
|
I think the problem is in your connectors configuration here: |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
Yes, there is indeed a trailing comma in your config. There is also one in the docs. I probably copied this from Python, where a trailing comma is ok. I'll fix the docs. Thanks for reporting! |
Beta Was this translation helpful? Give feedback.
-
|
JSON does not allow trailing commas |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
ytooyama
-
|
This worked well. Thank you. $ cat program-fix.sql
CREATE TABLE my_table1 (
id bigint not null primary key,
part bigint not null,
vendor bigint not null,
price integer
) WITH ('materialized' = 'true');
CREATE VIEW my_view
WITH (
'connectors' = '[{
"transport": {
"name": "kafka_output",
"config": {
"bootstrap.servers": "redpanda:9092",
"topic": "my_table1"
}
},
"format": {
"name": "avro",
"config": {
"update_format": "confluent_jdbc",
"registry_urls": ["http://redpanda:8081"],
"key_fields": ["id"]
}
}
}]'
)
AS SELECT * FROM my_table1; |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
JSON does not allow trailing commas