| Lists: | pgsql-in-general |
|---|
| From: | Vivekanand Joshi <vjoshi(at)zetainteractive(dot)com> |
|---|---|
| To: | pgsql-in-general(at)postgresql(dot)org |
| Subject: | Hardware Requirements |
| Date: | 2014-12-09 16:47:54 |
| Message-ID: | fe0ab720f41f734d5a71f9dea6629f4c@mail.gmail.com |
| Views: | Raw Message | Whole Thread | Download mbox | Resend email |
| Lists: | pgsql-in-general |
Hi Team,
We are thinking of shifting our data warehouse solution from Netezza to
PostgreSQL. I am reading a lot about PostgreSQL lately.
Can you please let us know the minimum[overall performance should be good]
hardware requirements for the below mentioned statistics. My question is
actually divided into two parts.
1. What hardware entities[RAM, Storage, Disk, RAID level etc. ]
should we keep in mind while finalizing the requirement? Sorry for my
ignorance here as I am totally new to this territory.
2. What should be the plan of action for performance benchmarking?
3. What should be the minimum hardware requirements for doing a POC
and comparing performance benchmark with Netezza?
*Parameter*
*Numbers on 7th Dec 2014*
Total number of Users
222
Total number of Application Users
110
Individual Accounts
112
Total number of Successful Queries on 7 December
425124
Total number of Unsuccessful Queries
2591
Maximum number of Queries in an *Hour*
79920
Maximum number of Queries in a *minute* when load was maximum in an hour
3143
Maximum number of Queries in a *second* when load was maximum in an hour
87
Number of Databases
82
Used Space
~1057 GB
Allocated Space
~4453 GB
What I actually want to achieve is right now is that running the same load
on Netezza and PostgreSQL [300 GB data, 20 concurrent queries, and 30k-40K
queries in an hour].
I have asked for the following configuration right now.
*Operating System* (Linux 64 bit)
*RAM* : 8 GB
*Storage*: 500 GB
*CPU Cores*: Minimum 4
Does that sound okay? Once again, my trivial questions could be irritating
but this is only a start.
Warm Regards,
Vivekanand Joshi
+919654227927
[image: Zeta Interactive]
185 Madison Ave. New York, NY 10016
| From: | Jayadevan M <maymala(dot)jayadevan(at)gmail(dot)com> |
|---|---|
| To: | vjoshi(at)zetainteractive(dot)com |
| Cc: | pgsql-in-general(at)postgresql(dot)org |
| Subject: | Re: Hardware Requirements |
| Date: | 2014-12-10 03:16:03 |
| Message-ID: | CAFS1N4hYRV2=mroXtxpBzu8sVhnkr7_5Pi3MY8ZCbkFRwp-3jQ@mail.gmail.com |
| Views: | Raw Message | Whole Thread | Download mbox | Resend email |
| Lists: | Postg스포츠 토토SQL : |
>
>
>
>
> 1. What hardware entities[RAM, Storage, Disk, RAID level etc. ]
> should we keep in mind while finalizing the requirement? Sorry for my
> ignorance here as I am totally new to this territory.
>
You could have a look at the type of config you have now. I think Netezza
ia a bit of a black box. Still, you may be able to get the RAM/CPU ?
> 2. What should be the plan of action for performance benchmarking?
>
Have a look at jmeter, that is what we use for performance testing. It
helps you generate load and provides decent analysis on response times. You
do need to get the response times for the queries in Netezza and then
compare that with what you get from PostgreSQL. Ensure you are executing
queries with different values for filters (check how to parameterize you
queries in jmeter -
http://testingfreak.com/tools/jmeter/parameterization-in-jmeter/) If you
use the same filters, the result will be in memory after the first round
and you are bound to get 'good' results afterwards. There are good videos
(youtube) on how to use jmeter. jmeter is not the easiest tool to learn,
but once you are past the initial 1-2 days learning curve, you will realize
it is pretty powerful.
If you are using a tool for reporting, you may be able to just make it
connect to PostgreSQL and do a comparison - no need for jmeter.