Questions tagged [optimization]
Optimization is the process of modifying a system to make some aspect of it work more efficiently or use fewer resources.
333
questions
0
votes
0answers
62 views
How to configure K8s cluster to utilize spare CPU capacity for ML training jobs (or other low-priority CPU-intensive work)
I'd like to use spare CPU capacity in our Kubernetes cluster for low-priority jobs -- specifically, ML training using Tensorflow in this case -- without depriving higher-priority services on our ...
0
votes
1answer
53 views
product import is broke behind cloudflare
Im having trouble to resolve my database errors and how to optimize it. Coz of the slowness of my server (mostly querries i believe), my imports turns with a cloudflare error code. (Cloudflare blocks ...
0
votes
0answers
23 views
Apache 2.4 Timeout configuration
I need to know how works the timeout configuration of Apache 2.2 or 2.4
I always use Timeout 900
I have a php script that is a proxy to shoutcast and then the connection can last for hours. If I set ...
1
vote
0answers
41 views
Wordpress UPDATE queries on MySQL database stuck
I have an Amazon 24XL server
96 Cores
378 GB RAM
Database size 5.7G
Debian GNU/Linux 9 (stretch)
PHP 7.3.16
mysql Ver 15.1 Distrib 10.3.22-MariaDB
I have only one WordPress site where users read ...
0
votes
2answers
382 views
MariaDB 10.3 per thread memory usage and low CPU utilization
I am a bit unsure why we are seeing these memory numbers while the cpu usage is actually very low.
-------- Storage Engine Statistics -----------------------------------------------------------------
...
0
votes
1answer
59 views
mysql thread and tomcat thread should be the same for a better perfoming?
my tomcat instance on ubuntu server running with mysql and only the application has access to mysql (only the service-user tomcat). I have small experience level with optimizing with mysql and tomcat. ...
0
votes
1answer
57 views
Where is my bottleneck: RAM, CPU or disk?
I have a 32 core, 64 thread, 128GB RAM system with internal SSD.
I'm running 64 data mining/simulation jobs in parallel that each load 1GB from disk and run for about 5-10 minutes .
I want to know ...
0
votes
3answers
123 views
Fastest possible configuration for a local MySQL database, no security needed?
We have a local Optiplex PC setup to run our shared MySQL MariaDB database with no way to access it from the outside world. It doesn't have any critical data that needs to be protected.
Basically, no ...
0
votes
1answer
132 views
Mysql Tuner output : Need help analyzing
-------- Performance Metrics -----------------------------------------------------------------------
[--] Up for: 75d 21h 28m 49s (441M q [67.390 qps], 1M conn, TX: 5795G, RX: 281G)
[--] Reads / ...
2
votes
2answers
2k views
XFS with No Barrier Mount option deprecated
I tried to perform SQL Server database restore with xfs filesystem and barrier=0 in Azure cloud environment. It performs restore of some 15GB data in around 8 minutes.
I heard this option is getting ...
3
votes
1answer
316 views
Debugging and fine-tuning the linux process scheduler
When debugging sporadic web application slowdowns, I've found that all the processes have quite high maximum scheduling delay.
# perf sched record -- sleep 10 && perf sched latency --sort max
...
1
vote
1answer
530 views
How to convert swap partition from RAID1 to RAID0 using mdadm
How to convert linux SWAP memory from RAID1 to RAID0?
Start with:2 exact size swap formatted partitions (/dev/sdc5 and /dev/sdd5) on 2 physically separate disks that are used via Software RAID(named ...
2
votes
4answers
4k views
Joins performed without indexes: 5568
I was trying to do mysql optimization. Yesterday the CPU usage was 100%.
I am trying to optimize with mysqltuner but this time I gave a mysqltuner warning.
I have a high-traffic db. 500-600 ...
8
votes
2answers
241 views
what is the IOPS behavior when partitions of single disk are used in an LVM?
I have an ubuntu 14.04.1 LTS server which have LVM(backed by hardware RAID5) with logical volume and a volume group named "dbstore-lv" and "dbstore-vg" which have sdb1 sdb2 sdb3 created from same sdb ...
0
votes
0answers
1k views
CloudFront HTTP/2 slower (high TTFB) than HTTP/1.1
My site was running on HTTP/1.1 with CloudFront at front, Webpagetest reports the load time usually at 2 seconds. Yesterday I enabled HTTP/2 (and SSL) on CloudFront, expecting to see an improvement. ...
0
votes
1answer
22 views
Which parameters and setting affect network throughput when connecting two machines together without a switch?
I have a situation where I need best possible throughput (TCP/IP sockets & SMB3) between two Windows Server 2016 connect with a 1m patch cable.
I have to use existing hardware.
When you connect ...
1
vote
2answers
3k views
mysqld taking 800% CPU since traffic increased on my site, how to fix
i have centos 7 x64 64 GB RAM and 500 GB of SSD dedicated server.,
And recently cpu usage was really high,
$ uptime
13:50:30 up 169 days, 1:53, 1 user, load average: 37.48, 37.64, 33.60
so i ...
0
votes
0answers
230 views
Should I worry about TTFB?
I have read differing opinions on the subject, but Im also wondering how much of this is affected by server location.
I have a VPS in NY, USA and im an Australian developer, VPS' are pretty pricey ...
8
votes
6answers
3k views
At what point is a server considered idle?
Conceptually, what is the definition of an idle server?
What resource metrics would you look at to make an assumption on whether or not a server was idle?
Would you look at:
CPU utilization
Disk ...
0
votes
0answers
95 views
Optimizing nginx with SSL for bot traffic without sessions
The service I run, cronitor.io, has a telemetry collection API that sees bursts of traffic around 1000rps. (overall baseline is much lower, call it 100rps)
Most of our requests come from things like ...
1
vote
1answer
2k views
How to speed up connection with a server in China
I have a EC2 server in China using Amazon AWS China.
It's a server with : Apache 2 and PHP The database is a RDS instance running MySQL (also in china)
The problem: Access from out of China is very ...
1
vote
1answer
3k views
Optimizing nginx client_body_buffer_size for web app accepting file uploads
When configuring nginx, what considerations affect client_body_buffer_size?
I've set it to 10m for a website where users upload photos and image-memes (kind of like 9gag). Note that ...
0
votes
1answer
134 views
How to simplify my nginx reverse proxy config
I have finally gotten around to setting up a Nginx reverse proxy to handle the multiple websites I host at my house since I only have one external IP address and everything is working, but what I want ...
2
votes
2answers
517 views
winbind authentication through apache slow
I have a linux machine setup to authenticate users using Active Directory with samba/winbind.
Apache is then setup to use that to authenticate the users. This is done using:
<IfModule ...
2
votes
1answer
228 views
Speed up backup of just ACLs on large file systems
I'm trying to make quick backups of just the ACLs on large GNU/Linux file systems. Extended permissions are not really necessary.
I run 4 little benchmarks on a small partition just to make an ...
2
votes
2answers
109 views
Minimal upgrade from one minor CentOS version to the next
I would like to update our remote systems from CentOS 7.2 to 7.3. Is there an option that would only install the minimum number of packages required? The standard upgrade would involve downloading ...
1
vote
1answer
200 views
Should a KVM host be doing things other than hosting VMs? (such as ZFS)?
What are the performance and stability implications of running resource intensive services in a hypervisor vs guest OS?
I want to set up a workstation with both Linux and Windows, hosted by (probably)...
0
votes
0answers
29 views
Optimize webserver to handle huge load spikes [duplicate]
Our application is growing fast so now we need to scale the infrastructure to don't slow down the entire website without worrying on how many users we have
The backend system is based on many curl ...
2
votes
1answer
941 views
Tune when sssd goes into offline mode
I have a linux server with sssd using an ldap server for the auth backend. The connection to the ldap server is flakey, so I get authentications which are fine and then suddenly one will take forever ...
-2
votes
2answers
102 views
Server bandwidth is going crazy, after reboot all ok
I have a streaming server with 10gbps card on it. I'm using ~2.5gbps.
My server is running perfect for 8-9 hours / day, and after that is going crazy, and everyone is freezing. At exactly the same ...
4
votes
0answers
1k views
`nginx reload` and `nginx -t` very slow - how to investigate
I have a quite small VPS on AWS (EC2 t2.nano) that is running an nginx server. while sometimes a sudo service nginx reload or nginx -t is blazing fast, most of the time it is horribly slow (>60 ...
4
votes
2answers
4k views
LVM cache in writeback mode is equivalent to external ext4 journal?
I am running ext4 filesystems on LVM. The two big speedup options I'm looking at are, LVM cache and the external ext4 journal.
It sounds like if I'm using a single SSD for this, LVM cache in ...
0
votes
2answers
803 views
nginx multiple paths (too many)
i got this working nginx config:
server {
listen 80;
server_name mydomain.com;
root /var/www/mydomain/wordpress;
index index.html index.php;
location /customer1 {
alias /var/www/...
0
votes
1answer
475 views
NGINX + PHP-FPM multidomain optimization
I am trying to optimize the parameters of PHP-FPM on a VPS with multiple domains.
Each domain is configured with its own user/group, NGINX uses different PHP-FPM sockets. For each domain I have ...
1
vote
0answers
115 views
To which value set ulimit
I'm setting up nginx from what I've understood the worker_connections value must not exceed the maximum number of open file descriptors retruned by ulimit -n.
On my fresh 16.04 ubuntu installation ...
0
votes
1answer
1k views
nginx: configuration file test failed [closed]
I using DirectAdmin and Nginx installed,
i have huge clients at the moment and i see "Nginx 503 Error" sometimes,
and i have 3Gb ram with 790 used ram...
And now i want increase Worker Connections, ...
2
votes
1answer
265 views
Move htaccess rules to apache configuration files
I'm running a website with Joomla on a dedicated server (Debian), and i've read that moving .htaccess rules to apache2 configuration files may result in a good performance improvement (Apache HTTP ...
-2
votes
1answer
115 views
How to choose database and backend server locations?
I could not find a tutorial for beginners for how to locate my servers.
For instance I use Compose.io for my MongoDB and DigitalOcean for my Meteor.js app.
Lets say I want to have fast service in ...
4
votes
0answers
759 views
Identifying bottleneck with nginx VPS load testing
I'm trying to optimize a Digital Ocean droplet (512mb), testing using loader.io
I'm testing on my homepage, which is HTTPS / PHP. I setup FastCGI page cache, which got me from 100 req/sec to 2,000 ...
0
votes
0answers
27 views
Way to know what source is reading the most from MySQL Server(RDS)?
I have a mysql server which is registering very large bandwidth usage. I want to know what options I have for:
Knowing what source is using the MySQL server most. (server ip?)
What tables or queries ...
1
vote
2answers
411 views
Track what is causing AWS RDS to use insanely high bandwidth
We are having a high traffic (100K hit/day) Drupal news website hosted on AWS. Its behind cloudflare & 2 Load Balanced Varnish servers. For some reason the bandwidth usage is very high for RDS. ...
-4
votes
1answer
99 views
My website is superslow but the %CPU is only 25%
I have 2 servers for my website :
One server 256GO RAM 20c/40t for MySQL
One server 256GO RAM 20c/40t for Apache
The MySQL server is always ok (30-50% of CPU is used).
But the Apache ...
1
vote
1answer
166 views
Ubuntu LAMP server busy at peak hours
I'm running a Ubuntu 14 server with LAMP on virtual cloud hosting (CityCloud).
The server is usually doing very well with response time<0.5s. However, the problems start at peak hours, mainly ...
0
votes
1answer
2k views
nginx time to first byte
I running several project on one machine, below with all the info.
on nginx config if PHP project use fastcgi cache, Node.js project use proxy_pass , and all project use gzip.
I'm new to maintain ...
0
votes
3answers
727 views
Hyper-V failover cluster auto load balancing
We have a 2 unit Hyper-V cluster and I was wondering if there is a way to auto load balance the two? If one unit is restarted then I need to manually reassign some of the VMs to the unused hypervisor, ...
0
votes
0answers
26 views
Go server response times
I just started playing around with a hosted VPS (running Ubuntu). I let it run the simplest Go server that listens to port 8080 and returns "hello world" on path /hello. Then I started sending ...
0
votes
1answer
693 views
How to allocate more resources to Node.JS process?
I'm not a (very good) back-end developer so understanding processes and memory are a little about my pay grade.
I'm currently building an app using the MEAN stack. I have a separate Express server ...
0
votes
0answers
12 views
ExpressJS + MongoDB: Better to make one API call with 10,000 objects, or 10,000 individual API calls? [duplicate]
I'm building an app that relies on a web scraper built in Node/Express, which operating on the same localhost as my front-facing Node/Express app.
I'm trying to optimise as much as possible and I'm ...
0
votes
1answer
322 views
Optimizing mysql and apache ovh vps [duplicate]
My website is 100% mysql php so it gets slowdown and sometimes server shutdown.
I'm using VPS Classic: The best cheap VPS - $2.99/month - OVH (VPS Classic 4 - 4 vCores and 8GB RAM).
I want some ...
5
votes
1answer
3k views
Nginx performance when running multiple instances on the same machine
I'm trying to understand the performance impact of having multiple nginx instances (masters) running on the same machine, rather than having them all load into a single instance using different server ...
