Lists: | sfpug |
---|
From: | "Jon Asher" <jon(dot)asher(at)gmail(dot)com> |
---|---|
To: | "SF Postgres" <sfpug(at)postgresql(dot)org> |
Subject: | AMD vs Intel |
Date: | 2007-05-17 16:40:38 |
Message-ID: | d24c7af0705170940g1787d2acmd8a99f468d89bbed@mail.gmail.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Lists: | sfpug |
Has anyone seen recent numbers comparing Postgres performance on the latest
AMD vs Intel chips?
I remember that several years ago AMD came out on top, but after a few years
of AMD glory it looks like Intel is back....
Jon
From: | Geoff Tolley <geoff(at)polimetrix(dot)com> |
---|---|
To: | Jon Asher <jon(dot)asher(at)gmail(dot)com> |
Cc: | SF Postgres <sfpug(at)postgresql(dot)org> |
Subject: | Re: AMD vs Intel |
Date: | 2007-05-17 18:09:44 |
Message-ID: | 464C9A68.9020803@polimetrix.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Lists: | sfpug |
Jon Asher wrote:
> Has anyone seen recent numbers comparing Postgres performance on the latest
> AMD vs Intel chips?
> I remember that several years ago AMD came out on top, but after a few
> years
> of AMD glory it looks like Intel is back....
The only one I found was this comparing Opteron 275's and 280's to Xeon
5160 (that's the Woodcrest), giving a 28% advantage to the Xeon vs the 280:
http://www.vaultnetworks.com/dedicated-servers/amd-vs-intel.html
This seems to quote numbers from this Anandtech article, which mentions
that it's a dual-socket setup:
http://www.anandtech.com/IT/showdoc.aspx?i=2772&p=9
Beat in mind that the Xeon costs twice as much as the 280 (can't speak for
the platform as a whole), but it's a point of reference nonetheless.
HTH,
Geoff
From: | Quinn Weaver <quinn(at)fairpath(dot)com> |
---|---|
To: | SF Postgres <sfpug(at)postgresql(dot)org> |
Subject: | Re: AMD vs Intel |
Date: | 2007-05-17 18:16:48 |
Message-ID: | 20070517181648.GB87661@fu.funkspiel.org |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Lists: | sfpug |
On Thu, May 17, 2007 at 11:09:44AM -0700, Geoff Tolley wrote:
> [...]
> Beat in mind that the Xeon costs twice as much as the 280 (can't speak for the
> platform as a whole), but it's a point of reference nonetheless.
Also bear in mind that a new server can cost more to cool over its lifetime
than it cost to buy(!) So check the thermal specs when you're comparing
models, if you care about that.
--
Quinn Weaver, independent contractor | President, San Francisco Perl Mongers
http://fairpath.com/quinn/resume/ | http://sf.pm.org/
From: | Jeff Frost <jeff(at)frostconsultingllc(dot)com> |
---|---|
To: | Geoff Tolley <geoff(at)polimetrix(dot)com> |
Cc: | Jon Asher <jon(dot)asher(at)gmail(dot)com>, SF Postgres <sfpug(at)postgresql(dot)org> |
Subject: | Re: AMD vs Intel |
Date: | 2007-05-17 18:18:11 |
Message-ID: | Pine.LNX.4.64.0705171113220.2595@glacier.frostconsultingllc.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Lists: | sfpug |
On Thu, 17 May 2007, Geoff Tolley wrote:
> Jon Asher wrote:
>> Has anyone seen recent numbers comparing Postgres performance on the latest
>> AMD vs Intel chips?
>> I remember that several years ago AMD came out on top, but after a few
>> years
>> of AMD glory it looks like Intel is back....
>
> The only one I found was this comparing Opteron 275's and 280's to Xeon 5160
> (that's the Woodcrest), giving a 28% advantage to the Xeon vs the 280:
>
> http://www.vaultnetworks.com/dedicated-servers/amd-vs-intel.html
>
> This seems to quote numbers from this Anandtech article, which mentions that
> it's a dual-socket setup:
>
> http://www.anandtech.com/IT/showdoc.aspx?i=2772&p=9
>
> Beat in mind that the Xeon costs twice as much as the 280 (can't speak for
> the platform as a whole), but it's a point of reference nonetheless.
I have a few clients running the latest Woodcrest Xeons and they outperform
the comparable Opterons at this time. If you search around on the
pgsql-perform archives, you'll likely find lots of info regarding this.
--
Jeff Frost, Owner <jeff(at)frostconsultingllc(dot)com>
Frost Consulting, LLC http://www.frostconsultingllc.com/
Phone: 650-780-7908 FAX: 650-649-1954
From: | Josh Berkus <josh(at)agliodbs(dot)com> |
---|---|
To: | sfpug(at)postgresql(dot)org |
Subject: | Re: AMD vs Intel |
Date: | 2007-05-17 22:03:21 |
Message-ID: | 200705171503.21277.josh@agliodbs.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Lists: | sfpug |
Jon,
> Has anyone seen recent numbers comparing Postgres performance on the latest
> AMD vs Intel chips?
> I remember that several years ago AMD came out on top, but after a few
> years of AMD glory it looks like Intel is back....
No numbers on the latest, no. However, I expect that the latest Intel chips
will do as well or better than AMD. In the long run, Intel has more & better
chip architects than AMD (some of whom they recently lured away from AMD) so
I'm expecting Intel to pull ahead now that they've realized they actually
need to compete.
While Sun inked a recent deal with Intel, none of those machines are actually
built yet for me to test.
--
Josh Berkus
PostgreSQL @ Sun
San Francisco
From: | "Larry Wissink" <lwissink(at)ebates(dot)com> |
---|---|
To: | "SF Postgres" <sfpug(at)postgresql(dot)org> |
Subject: | Data Corruption |
Date: | 2007-06-05 21:39:37 |
Message-ID: | F93D08A809C46B4A966D3DCF662B9B6804C4D36E@exchange2.corp.ebates.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Lists: | sfpug |
I know this is not really the point of this group, but I'm wondering if
someone can help me with a weird problem on our production dbs. Since
yesterday we have had problems with rows missing from a primary table
(table of users/email addresses). We can't figure out how the rows were
deleted because nothing is designed to delete these rows. The primary
reason I suspect it is a data corruption rather than bad code or
malicious user is that when I try to re-insert the missing row, Postgres
complains that it violates the primary key constraint.
So, any suggestions on where to look for Internal errors? Any known
bugs that could be causing this? Any suggestions on how to fix it?
Fortunately we should be able to recover most data from backup servers,
but it's still a big concern because obviously if it can happen in one
table it could happen anywhere else.
Ok, details.
So far, no hardware problems have been identified. I can go into the
hardware details, but I'll leave that aside for the moment.
Our PG version is: 7.4.7. (Yes I know we should upgrade...)
Here's what happens:
Missing User:
EBPRD1=# select user_id, user_username, user_email, user_password,
user_created_date from users where user_id = 6020900;
user_id | user_username | user_email | user_password |
user_created_date
---------+---------------+------------+---------------+-----------------
--
(0 rows)
Try to re-insert the missing user:
EBPRD1=# insert into users
(user_id, user_username, user_email, user_password, user_created_date )
values (6020900, 'sofifi97(at)optonline(dot)net',
'sofifi97(at)optonline(dot)net', '********', '2003-07-05
08:37:07.620');
EBPRD1-# EBPRD1-# ERROR: duplicate key violates unique constraint
"con_user_id_pri"
That constraint is of course a primary key constraint on the users
table.
I don't think I'd get that error if the row had been deleted in any
normal method.
Any suggestions or relevant postgres reference is greatly appreciated.
Larry.
I don't think the table structure is important, but here it is:
EBPRD1=# \d users
Table "public.users"
Column | Type | Modifiers
--------------------------+--------------------------+------------------
---
user_id | numeric | not null
user_username | character varying(255) | not null
user_email | character varying(255) | not null
user_referrer_url | character varying(2048) |
user_password | character varying(64) | not null
user_rebate_paid | numeric(9,0) |
user_rebate_due | numeric(9,0) |
user_referred1_paid | numeric(9,0) |
user_referred1_due | numeric(9,0) |
user_referred2_due | numeric(9,0) |
user_referred2_paid | numeric(9,0) |
user_referred3_due | numeric(9,0) |
user_referred3_paid | numeric(9,0) |
user_pri_ref_user_id | numeric |
user_sec_ref_user_id | numeric |
user_ter_ref_user_id | numeric |
user_fully_registered_c | character(1) |
user_wants_promo_mail_c | character(1) |
user_spare_flag_b | character(1) |
user_spare_flag_c | character(1) |
user_created_date | timestamp with time zone | not null
user_registration_type | character(3) |
user_username_number | numeric |
user_username_name | character varying(255) |
user_active | character(1) | default
'T'::bpchar
user_email_valid | character(1) | default
'T'::bpchar
user_wants_rebate_mail | character(1) |
user_password_hint | character varying(96) |
user_last_modified | timestamp with time zone |
user_primary_account_id | numeric |
user_unused_num1 | numeric |
user_referrer_banner | character varying(255) |
user_frn_banner_id | numeric(38,0) |
user_signup_page | character varying(50) |
user_showme_info_popup | character varying(1) |
user_showme_promo_popup | character varying(1) |
user_wants_mktg_mail | character varying(1) |
user_wants_sales_mail | character varying(1) |
user_wants_specials_mail | character varying(1) |
user_has_flag | character varying(1) |
user_registration_code | character varying(128) |
Indexes:
"con_user_id_pri" primary key, btree (user_id)
"users_useremail_uk" unique, btree (user_email)
"ix_user_last_modified" btree (user_last_modified)
"user_created_date_index" btree (user_created_date)
"users_pri_ref_indx" btree (user_pri_ref_user_id)
"users_sec_ref_indx" btree (user_sec_ref_user_id)
"users_ter_ref_indx" btree (user_ter_ref_user_id)
"users_username_indx" btree (user_username)
"users_username_no_indx" btree (user_username_name,
user_username_number)
Foreign-key constraints:
"con_user_ref_users_ter" FOREIGN KEY (user_ter_ref_user_id)
REFERENCES users(user_id) ON DELETE CASCADE
"con_user_ref_users_sec" FOREIGN KEY (user_sec_ref_user_id)
REFERENCES users(user_id) ON DELETE CASCADE
"con_user_ref_users_pri" FOREIGN KEY (user_pri_ref_user_id)
REFERENCES users(user_id) ON DELETE CASCADE
From: | Jeff Frost <jeff(at)frostconsultingllc(dot)com> |
---|---|
To: | Larry Wissink <lwissink(at)ebates(dot)com> |
Cc: | SF Postgres <sfpug(at)postgresql(dot)org> |
Subject: | Re: Data Corruption |
Date: | 2007-06-05 22:38:16 |
Message-ID: | Pine.LNX.4.64.0706051532500.24164@glacier.frostconsultingllc.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Lists: | sfpug |
Larry,
Just for giggles, you might try and reindex. I've seen this sort of
strangeness before when a unique index got corrupted. As you already know,
this should be a major motivation to upgrade to at least 7.4.17 as there are
some nice fixes that avoid data corruption problems (possibly like yours).
Check the HISTORY file of a recent release for specifics.
On Tue, 5 Jun 2007, Larry Wissink wrote:
> I know this is not really the point of this group, but I'm wondering if
> someone can help me with a weird problem on our production dbs. Since
> yesterday we have had problems with rows missing from a primary table
> (table of users/email addresses). We can't figure out how the rows were
> deleted because nothing is designed to delete these rows. The primary
> reason I suspect it is a data corruption rather than bad code or
> malicious user is that when I try to re-insert the missing row, Postgres
> complains that it violates the primary key constraint.
>
>
>
> So, any suggestions on where to look for Internal errors? Any known
> bugs that could be causing this? Any suggestions on how to fix it?
> Fortunately we should be able to recover most data from backup servers,
> but it's still a big concern because obviously if it can happen in one
> table it could happen anywhere else.
>
>
>
> Ok, details.
>
> So far, no hardware problems have been identified. I can go into the
> hardware details, but I'll leave that aside for the moment.
>
>
>
> Our PG version is: 7.4.7. (Yes I know we should upgrade...)
>
>
>
> Here's what happens:
>
>
>
> Missing User:
>
> EBPRD1=# select user_id, user_username, user_email, user_password,
> user_created_date from users where user_id = 6020900;
>
> user_id | user_username | user_email | user_password |
> user_created_date
>
> ---------+---------------+------------+---------------+-----------------
> --
>
> (0 rows)
>
>
>
> Try to re-insert the missing user:
>
> EBPRD1=# insert into users
>
> (user_id, user_username, user_email, user_password, user_created_date )
>
> values (6020900, 'sofifi97(at)optonline(dot)net',
> 'sofifi97(at)optonline(dot)net', '********', '2003-07-05
> 08:37:07.620');
>
> EBPRD1-# EBPRD1-# ERROR: duplicate key violates unique constraint
> "con_user_id_pri"
>
>
>
> That constraint is of course a primary key constraint on the users
> table.
>
>
>
> I don't think I'd get that error if the row had been deleted in any
> normal method.
>
>
>
> Any suggestions or relevant postgres reference is greatly appreciated.
>
>
>
> Larry.
>
>
>
>
>
>
>
> I don't think the table structure is important, but here it is:
>
> EBPRD1=# \d users
>
> Table "public.users"
>
> Column | Type | Modifiers
>
>
> --------------------------+--------------------------+------------------
> ---
>
> user_id | numeric | not null
>
> user_username | character varying(255) | not null
>
> user_email | character varying(255) | not null
>
> user_referrer_url | character varying(2048) |
>
> user_password | character varying(64) | not null
>
> user_rebate_paid | numeric(9,0) |
>
> user_rebate_due | numeric(9,0) |
>
> user_referred1_paid | numeric(9,0) |
>
> user_referred1_due | numeric(9,0) |
>
> user_referred2_due | numeric(9,0) |
>
> user_referred2_paid | numeric(9,0) |
>
> user_referred3_due | numeric(9,0) |
>
> user_referred3_paid | numeric(9,0) |
>
> user_pri_ref_user_id | numeric |
>
> user_sec_ref_user_id | numeric |
>
> user_ter_ref_user_id | numeric |
>
> user_fully_registered_c | character(1) |
>
> user_wants_promo_mail_c | character(1) |
>
> user_spare_flag_b | character(1) |
>
> user_spare_flag_c | character(1) |
>
> user_created_date | timestamp with time zone | not null
>
> user_registration_type | character(3) |
>
> user_username_number | numeric |
>
> user_username_name | character varying(255) |
>
> user_active | character(1) | default
> 'T'::bpchar
>
> user_email_valid | character(1) | default
> 'T'::bpchar
>
> user_wants_rebate_mail | character(1) |
>
> user_password_hint | character varying(96) |
>
> user_last_modified | timestamp with time zone |
>
> user_primary_account_id | numeric |
>
> user_unused_num1 | numeric |
>
> user_referrer_banner | character varying(255) |
>
> user_frn_banner_id | numeric(38,0) |
>
> user_signup_page | character varying(50) |
>
> user_showme_info_popup | character varying(1) |
>
> user_showme_promo_popup | character varying(1) |
>
> user_wants_mktg_mail | character varying(1) |
>
> user_wants_sales_mail | character varying(1) |
>
> user_wants_specials_mail | character varying(1) |
>
> user_has_flag | character varying(1) |
>
> user_registration_code | character varying(128) |
>
> Indexes:
>
> "con_user_id_pri" primary key, btree (user_id)
>
> "users_useremail_uk" unique, btree (user_email)
>
> "ix_user_last_modified" btree (user_last_modified)
>
> "user_created_date_index" btree (user_created_date)
>
> "users_pri_ref_indx" btree (user_pri_ref_user_id)
>
> "users_sec_ref_indx" btree (user_sec_ref_user_id)
>
> "users_ter_ref_indx" btree (user_ter_ref_user_id)
>
> "users_username_indx" btree (user_username)
>
> "users_username_no_indx" btree (user_username_name,
> user_username_number)
>
> Foreign-key constraints:
>
> "con_user_ref_users_ter" FOREIGN KEY (user_ter_ref_user_id)
> REFERENCES users(user_id) ON DELETE CASCADE
>
> "con_user_ref_users_sec" FOREIGN KEY (user_sec_ref_user_id)
> REFERENCES users(user_id) ON DELETE CASCADE
>
> "con_user_ref_users_pri" FOREIGN KEY (user_pri_ref_user_id)
> REFERENCES users(user_id) ON DELETE CASCADE
>
>
>
>
>
>
>
>
>
>
--
Jeff Frost, Owner <jeff(at)frostconsultingllc(dot)com>
Frost Consulting, LLC http://www.frostconsultingllc.com/
Phone: 650-780-7908 FAX: 650-649-1954
From: | "Jon Asher" <jon(dot)asher(at)gmail(dot)com> |
---|---|
To: | "Larry Wissink" <lwissink(at)ebates(dot)com>, "SF Postgres" <sfpug(at)postgresql(dot)org> |
Subject: | Re: Data Corruption |
Date: | 2007-06-05 22:44:38 |
Message-ID: | d24c7af0706051544s560ae6ablff3fdf35261b08d@mail.gmail.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Lists: | sfpug |
Be sure to follow the logic of your cascade deletes and any other triggers
that might exist. Did you rebuild your indexes- the most common corruption
point in my experience. There's a big difference between a row missing from
the index and missing from the table.
Be sure to post to the mailing list also, you might get a better response.
On 6/5/07, Larry Wissink <lwissink(at)ebates(dot)com> wrote:
>
> I know this is not really the point of this group, but I'm wondering if
> someone can help me with a weird problem on our production dbs. Since
> yesterday we have had problems with rows missing from a primary table (table
> of users/email addresses). We can't figure out how the rows were deleted
> because nothing is designed to delete these rows. The primary reason I
> suspect it is a data corruption rather than bad code or malicious user is
> that when I try to re-insert the missing row, Postgres complains that it
> violates the primary key constraint.
>
>
>
> So, any suggestions on where to look for Internal errors? Any known bugs
> that could be causing this? Any suggestions on how to fix it? Fortunately
> we should be able to recover most data from backup servers, but it's still a
> big concern because obviously if it can happen in one table it could happen
> anywhere else.
>
>
>
> Ok, details.
>
> So far, no hardware problems have been identified. I can go into the
> hardware details, but I'll leave that aside for the moment.
>
>
>
> Our PG version is: 7.4.7. (Yes I know we should upgrade…)
>
>
>
> Here's what happens:
>
>
>
> Missing User:
>
> EBPRD1=# select user_id, user_username, user_email, user_password,
> user_created_date from users where user_id = 6020900;
>
> user_id | user_username | user_email | user_password | user_created_date
>
> ---------+---------------+------------+---------------+-------------------
>
> (0 rows)
>
>
>
> Try to re-insert the missing user:
>
> EBPRD1=# insert into users
>
> (user_id, user_username, user_email, user_password, user_created_date )
>
> values (6020900, 'sofifi97(at)optonline(dot)net', '
> sofifi97(at)optonline(dot)net', '********', '2003-07-05 08:37:07.620');
>
> EBPRD1-# EBPRD1-# ERROR: duplicate key violates unique constraint
> "con_user_id_pri"
>
>
>
> That constraint is of course a primary key constraint on the users table.
>
>
>
>
> I don't think I'd get that error if the row had been deleted in any normal
> method.
>
>
>
> Any suggestions or relevant postgres reference is greatly appreciated.
>
>
>
> Larry.
>
>
>
>
>
>
>
> I don't think the table structure is important, but here it is:
>
> EBPRD1=# \d users
>
> Table "public.users"
>
> Column | Type | Modifiers
>
>
>
> --------------------------+--------------------------+---------------------
>
> user_id | numeric | not null
>
> user_username | character varying(255) | not null
>
> user_email | character varying(255) | not null
>
> user_referrer_url | character varying(2048) |
>
> user_password | character varying(64) | not null
>
> user_rebate_paid | numeric(9,0) |
>
> user_rebate_due | numeric(9,0) |
>
> user_referred1_paid | numeric(9,0) |
>
> user_referred1_due | numeric(9,0) |
>
> user_referred2_due | numeric(9,0) |
>
> user_referred2_paid | numeric(9,0) |
>
> user_referred3_due | numeric(9,0) |
>
> user_referred3_paid | numeric(9,0) |
>
> user_pri_ref_user_id | numeric |
>
> user_sec_ref_user_id | numeric |
>
> user_ter_ref_user_id | numeric |
>
> user_fully_registered_c | character(1) |
>
> user_wants_promo_mail_c | character(1) |
>
> user_spare_flag_b | character(1) |
>
> user_spare_flag_c | character(1) |
>
> user_created_date | timestamp with time zone | not null
>
> user_registration_type | character(3) |
>
> user_username_number | numeric |
>
> user_username_name | character varying(255) |
>
> user_active | character(1) | default 'T'::bpchar
>
> user_email_valid | character(1) | default 'T'::bpchar
>
> user_wants_rebate_mail | character(1) |
>
> user_password_hint | character varying(96) |
>
> user_last_modified | timestamp with time zone |
>
> user_primary_account_id | numeric |
>
> user_unused_num1 | numeric |
>
> user_referrer_banner | character varying(255) |
>
> user_frn_banner_id | numeric(38,0) |
>
> user_signup_page | character varying(50) |
>
> user_showme_info_popup | character varying(1) |
>
> user_showme_promo_popup | character varying(1) |
>
> user_wants_mktg_mail | character varying(1) |
>
> user_wants_sales_mail | character varying(1) |
>
> user_wants_specials_mail | character varying(1) |
>
> user_has_flag | character varying(1) |
>
> user_registration_code | character varying(128) |
>
> Indexes:
>
> "con_user_id_pri" primary key, btree (user_id)
>
> "users_useremail_uk" unique, btree (user_email)
>
> "ix_user_last_modified" btree (user_last_modified)
>
> "user_created_date_index" btree (user_created_date)
>
> "users_pri_ref_indx" btree (user_pri_ref_user_id)
>
> "users_sec_ref_indx" btree (user_sec_ref_user_id)
>
> "users_ter_ref_indx" btree (user_ter_ref_user_id)
>
> "users_username_indx" btree (user_username)
>
> "users_username_no_indx" btree (user_username_name,
> user_username_number)
>
> Foreign-key constraints:
>
> "con_user_ref_users_ter" FOREIGN KEY (user_ter_ref_user_id) REFERENCES
> users(user_id) ON DELETE CASCADE
>
> "con_user_ref_users_sec" FOREIGN KEY (user_sec_ref_user_id) REFERENCES
> users(user_id) ON DELETE CASCADE
>
> "con_user_ref_users_pri" FOREIGN KEY (user_pri_ref_user_id) REFERENCES
> users(user_id) ON DELETE CASCADE
>
>
>
>
>
>
>
>
>