Questions tagged [caching]
Questions regarding cache algorithms by applications and implementations of information caching by database engines and other information repository and presentation applications.
263 questions
0votes
0answers
31views
API design for precomputation cache [closed]
In my numeric code library I have a function totient_sum that depends on an expensive one-time precomputation totsum_range = [...], then different calls to totient_sum(n) are quick. There are several ...
- 342
6votes
2answers
400views
How can I keep data defragmented and sorted if it's large and often changes randomly?
This problem is very relevant to games and real-time simulations but it may have broader applications. It seems inherently difficult to solve. The problem: Imagine that you have a large buffer of data,...
4votes
1answer
242views
Are contiguous objects contiguous in virtual memory or physical?
More or less what the title says. Suppose we have a sequential container like vector in c++ that will store data contiguously. When we say that the data is stored contiguously do we mean that it's ...
- 169
3votes
3answers
474views
How can single thread execution speed further increase since frequency stagnates?
What are things that newer CPU can do to speed up single thread execution? multiple registers? (can compilers always benefit from it?) SIMD? (do compilers use SIMD without code annotation?) does a ...
- 2,280
3votes
2answers
389views
Populating Cache in microservices
These days I was asked by our technological leader to populate a cache. The exact nature of the request impacts a back-end (BE) system that operates on a database through a client library. The BE is a ...
- 147
-2votes
1answer
190views
What is the best way to cache paginated data when any page can be moved to and page size is changeable?
I have a React Redux web app that fetches data from an Express/Node backend and MySQL database. I have a table of records that I fetch and store in redux as an array of objects, which I display as a ...
-2votes
2answers
212views
How do I build my application with high throughput in mind? (Need guidance)
I am building a Spring boot REST API app that is part of a microservice architecture project. What I am planning: My app listens for events from two other services and after some business logic, ...
1vote
1answer
57views
Effectively invalidating multiple entries from one composed key
Context I m building a dashboard application gathering data from a Rest API This Rest API can be requested by client applications others than the dashboard to get data That data is then aggregated ...
- 1,561
0votes
2answers
226views
Can caching increase p90 response time
I'm learning about caching and I realized a positional problem I need clarification on. Suppose the database p90 response time is too high and we need to decrease it. We are considering adding a cache....
- 119
0votes
0answers
68views
Distributed caching system that scales and enables real-time UI updates?
I have a NextJS app for which I want to cache data from our backend APIs to reduce the load when we have high volumes of concurrent users scrolling through (or search) years-worth of historical data. ...
-1votes
1answer
171views
How do I solve caching problems such as cache invalidation and data race in a monolithic app?
When creating a distributed web application, cache invalidation can be a big deal. However, our web application doesn't need distributed load, as we don't expect to serve more than 1k users at a time. ...
1vote
0answers
110views
How to improve an Expo Go app with firebase and local cache in Redux
For learning purposes and fun, I created an Expo Go app with react-native for recipes. It has a firebase database and uses redux to manage state locally on each device. So far so good. A couple of ...
1vote
1answer
128views
Non blocking algorithm for invalidating and reloading cache in concurrent environment using Redis (with Redisson)
I'm trying to come up with a peace of code that would fetch centralised cache shared across multiple threads/app instances. Callers might come in swarms. The data is a large set, reads during ...
-2votes
2answers
276views
How does Java and other managed languages achieve any performance, if everything is allocated at random places of the heap? [closed]
Prelude Recently, I helped a friend of mine in coding him a problem for his university Algorithms course, where problems are submitted in Java. I sent him code with good O notation complexity, ...
- 105
0votes
2answers
270views
API - What are some good strategies to limit hitting database on query-based searches?
I'm building an API that allows people to search for books (just for simplicity). There is an endpoint that takes a query string and returns the top 10 matched results. For example: /api/v1/book/find?...
