Questions tagged [data]
Data are values of qualitative or quantitative variables, belonging to a set of items. Data in computing (or data processing) are represented in a structure, often tabular (represented by rows and columns), a tree (a set of nodes with parent-children relationship) or a graph structure (a set of interconnected nodes).
459 questions
2votes
1answer
85views
Is there any idea to display the progress information when the data is synchronized?
I need to use TypeScript (Node.js) to implement a library for data synchronization. The logic diagram is as follows: If we directly execute according to this logic, the synchronization can be ...
- 131
4votes
1answer
305views
When do regression models outperform naive methods?
Case1: I have the following task to do: Training by the consecutive 3 days to predict the each 4th day. Each day data represents one CSV file which has dimension 24x25. Every datapoints of each CSV ...
- 37
1vote
1answer
96views
Can DAO parse local files?
We need to retrieve data in the form of entities We have DAOs that hit a DB But sometimes we need to parse (local) XMLs to retrieve essentially the same entities Should we have a separate type for ...
- 1,503
0votes
3answers
211views
Architecture for downloading large number of large images
I am running a website for a customer who has terrabytes worth of images. Each JPG image is high-res (20MB) and belongs to a hierarchy like this: Group A SubGroup 1 subsubgroup a ...
- 1,701
0votes
1answer
163views
Why is it called Data-Oriented Design?
I find the name data-oriented design very confusing - it sounds like data-driven development (letting hard data determine decisions in development) or data-driven programming (control flow determined ...
- 111
1vote
1answer
160views
Architecture for a system where users want to use Excel for collecting and merging data
My organization handles batches of stuff that need to be checked by Quality Control. What I need is something for the people who work in Quality Control to be able to register and input data inside ...
-1votes
2answers
155views
How do you update a GUI table after DB ops?
I have a DAO that removes rows from a DB table. I have a GUI table representing some of those rows that passes user requests for deletion to that DAO How should I update the GUI table? I could attach ...
- 1,503
1vote
1answer
125views
Single-source data warehouse permissions management
We (Data Platform team) are reviewing how we configure and apply permissions against our data warehouse objects, and I'm curious what tools or custom systems you might be using for this. For context ...
1vote
4answers
304views
How to decide between keeping data within the code or in a database
As an example, we have an entity called Invoice which has bills of purchased services. public class Invoice { private readonly List<Bill> _serviceBills; public string InvoiceId { get; } ...
1vote
1answer
155views
Persisting data in a mobile app backed by a rest API back-end, advices [closed]
So I am working on this mobile application using MAUI, which is backed by a Rest API in ASP.NET Core. I want to be able to use the app offline, and the user can create/edit some data. This data is ...
- 155
7votes
3answers
1kviews
Prevent analytics from crashing the production database
At the core of my business (say, an online store) is a Postgres database that stores products and transactions. During day-to-day operations, the load on the database is not heavy. However, there is ...
1vote
1answer
145views
How to approach converting to and from kafka messages?
I would like to have a series of small stand-alone services that would either consume a Kafka topic and output the data into a different system or the reverse: receive data from a system and produce ...
- 11
0votes
1answer
141views
Storing Data For Consumption in Python
I have a program which needs some constant data, in JSON-like format. However, this data only needs to be consumed by my Python program, and by making it Python code, I can include types like datetime....
- 111
1vote
3answers
774views
How do you test whether schema changes will break services?
I maintain a relational database of sorts, and occasionally a feature request requires a schema change (eg. add a new column, etc...). However, a number of "services" consume this data. It's ...
- 343
0votes
0answers
655views
Transactionally update a set of files in s3
I have a bucket with several csv files at differing paths. The problem is that I want to update these csv files transactionally. The s3 bucket should represent the "latest" consistent set of ...
