24,106 questions
-2votes
0answers
64views
What is the most efficient way to keep an SQL Table updated according to a CSV? [closed]
I want to keep a table in my database to be updated with a public online csv file. The file constantly has new rows added and removed. I have a VM to run Python notebooks, and an SQL Server. What is ...
0votes
1answer
40views
optimized multi-tenant data model to support tenants without increasing the storage, using Kafka as a message queue
I'm working on a SAAS product where we have a multi-tenant data model with multiple fields that are specific to tenants. I am using Kafka as a message queue and PostgreSQL as datastore. The way I ...
0votes
0answers
44views
Inserting data into a Postgres database with Trino causes an error io.trino.spi.type.IntegerType
I have a Trino that reads Parquet (which was converted from JSON) and wants to insert that data into a PostgreSQL database. When defining the Trino schema and creating a table, it is ok. But after ...
-4votes
0answers
41views
ERD system developer CourseWord
I am designing a database. For the address part, I want to use a hierarchy like the picture. Am I doing it right? Or should I connect "accommodation" to nation first and then step back to ...
-1votes
1answer
61views
When should double validation be implemented with both the database and the backend? [closed]
I'm trying to figure out how to balance security, performance, and best practices in the validation process of the data of a REST API and its interaction with the database. Say you have a book table ...
3votes
3answers
90views
Which column to index in multicolumn indexing?
UserID First Middle Last Type CreatedAt 123 John Henry Doe Mage 03-28-2025 Let's say I have the following table above. I would like to create index to help speed up my queries. All queries would like ...
1vote
0answers
100views
dimensional modeling from two different source systems for the same business process?
I have two transactional systems that is used for the same operational business activity: purchase order transactions. One system is legacy and the other is a new modern one. They have different ...
0votes
0answers
52views
FIFO inventory accounting for blockchain data in SQL
I'm trying to implement real-time analytics on aggregated blockchain data. My database stores swap events (SwapEvent table) with information about tokens traded, amounts, and USD values. Currently, I'...
0votes
1answer
169views
Does "tuples are not necessarily distinct" imply they are equal? How do I show whether this multivalued dependency holds in the example table?
From the book Fundamentals of Database Systems (7th edition) by Elmasri et al., pages 475-476: A multivalued dependency [MVD] X ↠ Y specified on relation schema R, where X and Y are both subsets of R,...
0votes
1answer
36views
Is there a mechanism to set different priorities to ensure that access to postgresql database in golang? [closed]
The server I developed with golang is divided into two categories when accessing the database. One category is data with redis cache, which is generated very frequently, but inserted into the database ...
0votes
2answers
147views
SQL Server table scan when using SELECT *
I am working with SQL Server 2019 and have a TVF that retrieves products based on a list of categories. However, I noticed that when I use SELECT *, the query results in a table scan, whereas ...
0votes
2answers
69views
Integer PK but a GUID as FK
In our current PostgreSQL DB, primary keys are Ints. However, in almost all of the communications between services another candidate key is used, a GUID. While I am not the original author of the ...
0votes
0answers
32views
Special many to many relation in SQLAlchemy
I am trying to use sqlalchemy to model a database consisting of two classes A and B. The B class has two fields: B.a (1 to n) and B.alist (n to n). I am trying to follow the Setting Bi-Directional ...
1vote
2answers
65views
How should I paginate a SQL query where the rows have no natural ordering?
I've inherited a code base with an associated database schema. The schema has numeric, auto-incrementing primary keys. It does pagination with queries like this: WITH params AS ( SELECT id ...
1vote
3answers
89views
Oracle Sequence Gaps: Are Skipped Values Ever Reused
I use an Oracle sequence of the form: CREATE SEQUENCE MY_SEQUENCE INCREMENT BY 1 START WITH 1000000000 MAXVALUE 9999999999 MINVALUE 1000000001 NOCYCLE CACHE 20 NOORDER; This sequence is used in an ...