[Pljava-dev] Fw: out of memery

pljava-dev, hello??

I set "log_min_messages = debug1" in "postgresql.conf" of pgsql. When the erro("out of memery") happened , i found the followed message in the configur file.
2006-03-20 16:41:442280 LOG: autovacuum: processing database "postgres"
TopMemoryContext: 75160 total in 9 blocks; 12928 free (20 chunks); 62232 used
unnamed prepared statement: 1040384 total in 7 blocks; 463680 free (6 chunks); 576704 used
TopTransactionContext: 8192 total in 1 blocks; 7336 free (0 chunks); 856 used
SPI Exec: 0 total in 0 blocks; 0 free (0 chunks); 0 used
SPI Proc: 273670144 total in 67 blocks; 3840 free (29 chunks); 273666304 used
SPI Plan: 3072 total in 2 blocks; 1456 free (1 chunks); 1616 used
SPI Plan: 1024 total in 1 blocks; 224 free (0 chunks); 800 used
SPI Plan: 1024 total in 1 blocks; 224 free (0 chunks); 800 used
SPI Plan: 3072 total in 2 blocks; 608 free (0 chunks); 2464 used
PL/PgSQL function context: 8192 total in 1 blocks; 3968 free (8 chunks); 4224 used
SPI Plan: 3072 total in 2 blocks; 728 free (0 chunks); 2344 used
SPI Plan: 3072 total in 2 blocks; 1032 free (0 chunks); 2040 used
SPI Plan: 3072 total in 2 blocks; 1104 free (0 chunks); 1968 used
SPI Plan: 7168 total in 3 blocks; 1616 free (0 chunks); 5552 used
Type information cache: 8192 total in 1 blocks; 1864 free (0 chunks); 6328 used
PL/Java: 516096 total in 6 blocks; 397080 free (702 chunks); 119016 used
SPI Plan: 1024 total in 1 blocks; 224 free (0 chunks); 800 used
SPI Plan: 7168 total in 3 blocks; 1608 free (0 chunks); 5560 used
SPI Plan: 1024 total in 1 blocks; 80 free (0 chunks); 944 used
SPI Plan: 1024 total in 1 blocks; 224 free (0 chunks); 800 used
SPI Plan: 3072 total in 2 blocks; 1136 free (0 chunks); 1936 used
PL/PgSQL function context: 8192 total in 1 blocks; 2592 free (10 chunks); 5600 used
PLpgSQL function cache: 21784 total in 2 blocks; 5968 free (0 chunks); 15816 used
CFuncHash: 8192 total in 1 blocks; 4936 free (0 chunks); 3256 used
Record information cache: 8192 total in 1 blocks; 1864 free (0 chunks); 6328 used
Operator class cache: 8192 total in 1 blocks; 4936 free (0 chunks); 3256 used
MessageContext: 8192 total in 1 blocks; 7840 free (0 chunks); 352 used
smgr relation table: 8192 total in 1 blocks; 1840 free (0 chunks); 6352 used
Portal hash: 8192 total in 1 blocks; 3912 free (0 chunks); 4280 used
PortalMemory: 8192 total in 1 blocks; 8040 free (3 chunks); 152 used
PortalHeapMemory: 1024 total in 1 blocks; 880 free (0 chunks); 144 used
ExecutorState: 1141402016 total in 204 blocks; 7923848 free (3633 chunks); 1133478168 used
HashTableContext: 0 total in 0 blocks; 0 free (0 chunks); 0 used
HashBatchContext: 16384 total in 1 blocks; 8168 free (0 chunks); 8216 used
HashTableContext: 0 total in 0 blocks; 0 free (0 chunks); 0 used
HashBatchContext: 16384 total in 1 blocks; 4768 free (0 chunks); 11616 used
ExprContext: 0 total in 0 blocks; 0 free (0 chunks); 0 used
ExprContext: 0 total in 0 blocks; 0 free (0 chunks); 0 used
ExecutorState: 2113616 total in 10 blocks; 2066688 free (3440 chunks); 46928 used
ExprContext: 8192 total in 1 blocks; 8176 free (0 chunks); 16 used
ExprContext: 0 total in 0 blocks; 0 free (0 chunks); 0 used
ExprContext: 8192 total in 1 blocks; 8176 free (0 chunks); 16 used
ExprContext: 0 total in 0 blocks; 0 free (0 chunks); 0 used
ExprContext: 0 total in 0 blocks; 0 free (0 chunks); 0 used
ExprContext: 0 total in 0 blocks; 0 free (0 chunks); 0 used
ExprContext: 0 total in 0 blocks; 0 free (0 chunks); 0 used
ExprContext: 0 total in 0 blocks; 0 free (0 chunks); 0 used
ExprContext: 0 total in 0 blocks; 0 free (0 chunks); 0 used
ExprContext: 8192 total in 1 blocks; 8176 free (0 chunks); 16 used
ExprContext: 0 total in 0 blocks; 0 free (0 chunks); 0 used
ExprContext: 0 total in 0 blocks; 0 free (0 chunks); 0 used
ExprContext: 0 total in 0 blocks; 0 free (0 chunks); 0 used
ExprContext: 8192 total in 1 blocks; 8176 free (0 chunks); 16 used
ExprContext: 0 total in 0 blocks; 0 free (0 chunks); 0 used
ExprContext: 0 total in 0 blocks; 0 free (0 chunks); 0 used
ExprContext: 0 total in 0 blocks; 0 free (0 chunks); 0 used
ExprContext: 0 total in 0 blocks; 0 free (0 chunks); 0 used
AggContext: 0 total in 0 blocks; 0 free (0 chunks); 0 used
ExprContext: 0 total in 0 blocks; 0 free (0 chunks); 0 used
ExprContext: 0 total in 0 blocks; 0 free (0 chunks); 0 used
Relcache by OID: 8192 total in 1 blocks; 2856 free (0 chunks); 5336 used
CacheMemoryContext: 1040384 total in 7 blocks; 291352 free (0 chunks); 749032 used
?????????_????????? 7168 total in 3 blocks; 1824 free (0 chunks); 5344 used
__mapping__?????????_????????? 3072 total in 2 blocks; 40 free (0 chunks); 3032 used
??????_????????? 3072 total in 2 blocks; 976 free (0 chunks); 2096 used
?????????_????????? 7168 total in 3 blocks; 2800 free (0 chunks); 4368 used
??????_????????? 7168 total in 3 blocks; 584 free (0 chunks); 6584 used
__mapping__??????_????????? 7168 total in 3 blocks; 3504 free (0 chunks); 3664 used
??????_????????? 7168 total in 3 blocks; 1312 free (0 chunks); 5856 used
__mapping__??????_????????? 7168 total in 3 blocks; 3880 free (0 chunks); 3288 used
??????_????????? 7168 total in 3 blocks; 1872 free (0 chunks); 5296 used
??????_????????? 7168 total in 3 blocks; 2304 free (0 chunks); 4864 used
pg_class_relname_nsp_index: 1024 total in 1 blocks; 328 free (0 chunks); 696 used
????????????_????????? 15360 total in 4 blocks; 4768 free (0 chunks); 10592 used
__mapping__????????????_????????? 7168 total in 3 blocks; 1536 free (0 chunks); 5632 used
????????????_????????? 15360 total in 4 blocks; 7488 free (0 chunks); 7872 used
pg_tablespace_spcname_index: 1024 total in 1 blocks; 392 free (0 chunks); 632 used
pg_tablespace_oid_index: 1024 total in 1 blocks; 392 free (0 chunks); 632 used
pg_toast_2618_index: 1024 total in 1 blocks; 328 free (0 chunks); 696 used
pg_tables: 15360 total in 4 blocks; 2752 free (0 chunks); 12608 used
ignite_sys_virtualrelationmapping_pkey: 1024 total in 1 blocks; 328 free (0 chunks); 696 used
ignite_sys_virtualrelationdefinition_pkey: 1024 total in 1 blocks; 256 free (0 chunks); 768 used
pg_description_o_c_o_index: 1024 total in 1 blocks; 256 free (0 chunks); 768 used
pg_attrdef_oid_index: 1024 total in 1 blocks; 392 free (0 chunks); 632 used
ignite_sys_remotetabledefinition_pkey: 1024 total in 1 blocks; 328 free (0 chunks); 696 used
pg_toast_16406_index: 1024 total in 1 blocks; 328 free (0 chunks); 696 used
jar_entry_jarid_key: 1024 total in 1 blocks; 328 free (0 chunks); 696 used
jar_entry_pkey: 1024 total in 1 blocks; 392 free (0 chunks); 632 used
classpath_entry_pkey: 1024 total in 1 blocks; 328 free (0 chunks); 696 used
jar_repository_jarname_key: 1024 total in 1 blocks; 392 free (0 chunks); 632 used
jar_repository_pkey: 1024 total in 1 blocks; 392 free (0 chunks); 632 used
pg_attrdef_adrelid_adnum_index: 1024 total in 1 blocks; 328 free (0 chunks); 696 used
ignite_sys_datasource_pkey: 1024 total in 1 blocks; 392 free (0 chunks); 632 used
ignite_sys_datasourcewrapper_pkey: 1024 total in 1 blocks; 392 free (0 chunks); 632 used
pg_index_indrelid_index: 1024 total in 1 blocks; 392 free (0 chunks); 632 used
pg_type_typname_nsp_index: 1024 total in 1 blocks; 328 free (0 chunks); 696 used
pg_type_oid_index: 1024 total in 1 blocks; 392 free (0 chunks); 632 used
pg_trigger_tgrelid_tgname_index: 1024 total in 1 blocks; 328 free (0 chunks); 696 used
pg_statistic_relid_att_index: 1024 total in 1 blocks; 328 free (0 chunks); 696 used
pg_auth_members_member_role_index: 1024 total in 1 blocks; 328 free (0 chunks); 696 used
pg_auth_members_role_member_index: 1024 total in 1 blocks; 328 free (0 chunks); 696 used
pg_rewrite_rel_rulename_index: 1024 total in 1 blocks; 328 free (0 chunks); 696 used
pg_proc_proname_args_nsp_index: 1024 total in 1 blocks; 256 free (0 chunks); 768 used
pg_proc_oid_index: 1024 total in 1 blocks; 392 free (0 chunks); 632 used
pg_operator_oprname_l_r_n_index: 1024 total in 1 blocks; 192 free (0 chunks); 832 used
pg_operator_oid_index: 1024 total in 1 blocks; 392 free (0 chunks); 632 used
pg_opclass_oid_index: 1024 total in 1 blocks; 392 free (0 chunks); 632 used
pg_opclass_am_name_nsp_index: 1024 total in 1 blocks; 256 free (0 chunks); 768 used
pg_namespace_oid_index: 1024 total in 1 blocks; 392 free (0 chunks); 632 used
pg_namespace_nspname_index: 1024 total in 1 blocks; 392 free (0 chunks); 632 used
pg_language_oid_index: 1024 total in 1 blocks; 392 free (0 chunks); 632 used
pg_language_name_index: 1024 total in 1 blocks; 392 free (0 chunks); 632 used
pg_inherits_relid_seqno_index: 1024 total in 1 blocks; 328 free (0 chunks); 696 used
pg_index_indexrelid_index: 1024 total in 1 blocks; 392 free (0 chunks); 632 used
pg_authid_oid_index: 1024 total in 1 blocks; 392 free (0 chunks); 632 used
pg_authid_rolname_index: 1024 total in 1 blocks; 392 free (0 chunks); 632 used
pg_database_datname_index: 1024 total in 1 blocks; 392 free (0 chunks); 632 used
pg_conversion_oid_index: 1024 total in 1 blocks; 392 free (0 chunks); 632 used
pg_conversion_name_nsp_index: 1024 total in 1 blocks; 328 free (0 chunks); 696 used
pg_conversion_default_index: 1024 total in 1 blocks; 192 free (0 chunks); 832 used
pg_class_oid_index: 1024 total in 1 blocks; 392 free (0 chunks); 632 used
pg_cast_source_target_index: 1024 total in 1 blocks; 328 free (0 chunks); 696 used
pg_attribute_relid_attnum_index: 1024 total in 1 blocks; 328 free (0 chunks); 696 used
pg_attribute_relid_attnam_index: 1024 total in 1 blocks; 328 free (0 chunks); 696 used
pg_amproc_opc_proc_index: 1024 total in 1 blocks; 256 free (0 chunks); 768 used
pg_amop_opr_opc_index: 1024 total in 1 blocks; 328 free (0 chunks); 696 used
pg_amop_opc_strat_index: 1024 total in 1 blocks; 256 free (0 chunks); 768 used
pg_aggregate_fnoid_index: 1024 total in 1 blocks; 392 free (0 chunks); 632 used
MdSmgr: 8192 total in 1 blocks; 7264 free (1 chunks); 928 used
LockTable (locallock hash): 8192 total in 1 blocks; 3912 free (0 chunks); 4280 used
Timezones: 48408 total in 2 blocks; 5968 free (0 chunks); 42440 used
ErrorContext: 8192 total in 1 blocks; 8176 free (5 chunks); 16 used
2006-03-20 16:42:252288441e671b.8f0 DEBUG: Exception in function heap_formtuple
org.postgresql.pljava.internal.ServerException: out of memory
at org.postgresql.pljava.internal.TupleDesc._formTuple(Native Method)
at org.postgresql.pljava.internal.TupleDesc.formTuple(TupleDesc.java:71)
at org.postgresql.pljava.jdbc.SingleRowWriter.getTupleAndClear(SingleRowWriter.java:104)
2006-03-20 16:42:262288441e671b.8f0 ERROR: out of memory
2006-03-20 16:42:262288441e671b.8f0 DETAIL: Failed on request of size 222.

It seems that the pl/java's class has enough memery and the error leads postgres process to terminate. How can i deal with the problem ?

>pljava-dev-request,??????
>
> HI. I used pl/java's function to get resultset from the remote database . When the result was 1GB, i got 'out of memery' error .
> SERVER : p42.8G , 768MB RAM
> JVM MEMERY : 384MB
>
> I don't know where the problem happened . Can pl/java deal with these datas? I hope to get a correct answer.
> Thank you very much.
>
>
>
????????????????lifeng
????????????????lifenggod at 263.net
????????????????????2006-03-20

lifeng wrote:
> pljava-dev, hello?
>
> I set "log_min_messages = debug1" in "postgresql.conf" of pgsql. When the erro("out of memery") happened , i found the followed message in the configur file.
> ...
> SPI Proc: 273670144 total in 67 blocks; 3840 free (29 chunks); 273666304 used
> ...
> ExecutorState: 1141402016 total in 204 blocks; 7923848 free (3633 chunks); 1133478168 used
> ...
>
> It seems that the pl/java's class has enough memery and the error leads postgres process to terminate. How can i deal with the problem ?
>
>

This doesn't look good at all. It seems the ExecutorState MemoryContext
is collecting everything while your huge query is running. I'll have to
investigate this further and get back to you.

Regards,
Thomas Hallgren