sqlanywhere

Sybase: Stored Procedure called from within another Stored Procedure is too slow

亡梦爱人 — Sat, 25 Jan 2020 00:10:10 +0000

Sybase: Stored Procedure called from within another Stored Procedure is too slow 亡梦爱人 2020-01-25 08:10:10

问题

I'm writing a stored procedure for a Sybase database. I'm using Sybase Central 16.0 as my development environment. The machine I'm using runs Microsoft Windows Server 2012 R2 Standard and has 16GB RAM running on a 2.8GHz CPU.

My stored procedure uses a cursor to iterate over the records in a table with about 400,000 reecords. Each record is written incrementally into a LONG VARCHAR variable and every Nth record the proc will run an MD5 hash value on the variable and store the value in a separate table.

TABLE_NAME, DATE_TIME_RAN, FROM_RECORD, TO_RECORD, HASH_VALUE

If I run only the stored procedure to hash this table as a SQL block in SQL Anywhere (e.g.: BEGIN ... <hash the table here> ... END;) it goes through all records and completes successfully in about two minutes. However if I run this stored procedure as an embedded command in another stored procedure (e.g.: CALL <MY_SCHEMA>.<MY_STORED_PROCEDURE>) then it never completes.

Why would running the stored procedure (on the same dataset) from within another stored procedure perform differently?

回答1:

Managed to find a much better solution to the issue without trawling through the table. I thought I'd post the solution here for anyone who might face a similar issue.

The requirement for the stored procedure was to loop through a large table one row at a time, concatenating the contents of every column in the row into a string and assigning this to a variable. Every N rows this variable's value would be written to a separate table. Previously I had been using a cursor to do this but a developer on our team discovered a much faster way using the WITH clause.

INSERT INTO <MY_SCHEMA>.<MY_TABLE_THAT_WILL_CONTAIN_THE_CONCATENATED_VALUES_OF_EVERY_N_ROWS>
WITH 
    CONCATENATE_ROWS AS (
            SELECT RANK() OVER (ORDER BY <PRIMARY_KEY_COLUMN>) AS ROWID, <PRIMARY_KEY_COLUMN>, <COLUMN_1> || '' || <COLUMN_2> || '' || ... <COLUMN_N> AS ROW_DETAIL
            FROM <MY_TABLE_THAT_I_AM_QUERYING> 
            ORDER BY <PRIMARY_KEY_COLUMN>
    ), 
    GROUPED_ROWS AS (
            SELECT (((CONCATENATE_ROWS.ROWID-1)/ <number of rows I want to concatenate, e.g.: 10>)+1) AS GROUPID, CAST(LIST(CONCATENATE_ROWS.ROW_DETAIL, '' ORDER BY <PRIMARY_KEY_COLUMN>) AS VARCHAR(4000)) AS CONCAT_DETAILS
             FROM CONCATENATE_ROWS 
             GROUP BY (((CONCAT_ORDERS.ROWID-1)/ <number of rows I want to concatenate, e.g.: 10>)+1)
    )
SELECT <Whatever columns I want to insert into <MY_TABLE_THAT_WILL_CONTAIN_THE_CONCATENATED_VALUES_OF_EVERY_N_ROWS>> 
FROM GROUPED_ROWS;

来源：https://stackoverflow.com/questions/54215723/sybase-stored-procedure-called-from-within-another-stored-procedure-is-too-slow

标签

sql

stored-procedures

sybase

sqlanywhere

sqlperformance

Cannot open Interactive sql from command prompt

余生长醉 — Wed, 15 Jan 2020 03:23:48 +0000

Cannot open Interactive sql from command prompt 余生长醉 2020-01-15 11:23:48

问题

I have added my own procedure to run as soon as user logs, using

SET OPTION PUBLIC.post_login_procedure = 'xxx.Myprocedure';

I need to set custom message on pop up this provides when user logs in. The pop up is working, when I manually login in from Sybase central. however, when I run dbisql -c "DSN=myDSN" from command prompt Interactive sql opens and I get the popup that stays on forever!

I cannot post images yet but I can send u one, it says "Connecting to database.."

I get this pop up only when I have set the popup to appear through post_login_procedure , If i remove that then I can connect to interactive sql without any problem.

Please help, Thanks

来源：https://stackoverflow.com/questions/25897338/cannot-open-interactive-sql-from-command-prompt

标签

sybase

sqlanywhere

Cannot open Interactive sql from command prompt

て烟熏妆下的殇ゞ — Wed, 15 Jan 2020 03:23:29 +0000

Cannot open Interactive sql from command prompt て烟熏妆下的殇ゞ 2020-01-15 11:23:29

问题

I have added my own procedure to run as soon as user logs, using

SET OPTION PUBLIC.post_login_procedure = 'xxx.Myprocedure';

I cannot post images yet but I can send u one, it says "Connecting to database.."

I get this pop up only when I have set the popup to appear through post_login_procedure , If i remove that then I can connect to interactive sql without any problem.

Please help, Thanks

来源：https://stackoverflow.com/questions/25897338/cannot-open-interactive-sql-from-command-prompt

标签

sybase

sqlanywhere

Cannot open Interactive sql from command prompt

孤者浪人 — Wed, 15 Jan 2020 03:23:11 +0000

Cannot open Interactive sql from command prompt 孤者浪人 2020-01-15 11:23:11

问题

I have added my own procedure to run as soon as user logs, using

SET OPTION PUBLIC.post_login_procedure = 'xxx.Myprocedure';

I cannot post images yet but I can send u one, it says "Connecting to database.."

I get this pop up only when I have set the popup to appear through post_login_procedure , If i remove that then I can connect to interactive sql without any problem.

Please help, Thanks

来源：https://stackoverflow.com/questions/25897338/cannot-open-interactive-sql-from-command-prompt

标签

sybase

sqlanywhere

SQL Anywhere v10 Syntax error near OUTPUT

岁酱吖の — Wed, 15 Jan 2020 01:48:13 +0000

SQL Anywhere v10 Syntax error near OUTPUT 岁酱吖の 2020-01-15 09:48:13

问题

I'm attempting to output a table to an outside file. I've found a few questions regarding this and followed the answers from there without any luck.

SELECT * FROM transactions; OUTPUT TO 'C:\Users\administrator\Desktop\Test.txt'

Is the statement I've been using, I've attempted different variations with formatting and file types such as .csv with no change.

Which produces:

ErrorCode : 102 SQLState : 42W04 Message : SQL Anywhere Error -131: Syntax error near 'OUTPUT' on line 1

SQL =

OUTPUT TO 'C:\Users\administrator\Desktop\Test.txt'

Appreciate all your help

回答1:

Are you running this through dbisql, or in a different application? OUTPUT TO is a dbisql command, not a SQL statement recognized by the database server. You can use the UNLOAD statement in any application to allow the server to create the file.

Disclaimer: I work for SAP in SQL Anywhere engineering.

来源：https://stackoverflow.com/questions/33677756/sql-anywhere-v10-syntax-error-near-output

标签

sqlanywhere

How to delete duplicate rows in sybase, when you have no unique key?

僤鯓⒐⒋嵵緔 — Tue, 14 Jan 2020 19:35:06 +0000

How to delete duplicate rows in sybase, when you have no unique key? 僤鯓⒐⒋嵵緔 2020-01-15 03:35:06

问题

Yes, you can find similar questions numerous times, but: the most elegant solutions posted here, work for SQL Server, but not for Sybase (in my case Sybase Anywhere 11). I have even found some Sybase-related questions marked as duplicates for SQL Server questions, which doesn't help.

One example for solutions I liked, but didn't work, is the WITH ... DELETE ... construct.

I have found working solutions using cursors or while-loops, but I hope it is possible without loops.

I hope for a nice, simple and fast query, just deleting all but one exact duplicate.

Here a little framework for testing:

IF OBJECT_ID( 'tempdb..#TestTable' ) IS NOT NULL
  DROP TABLE #TestTable;

CREATE TABLE #TestTable (Column1 varchar(1), Column2 int);

INSERT INTO #TestTable VALUES ('A', 1);
INSERT INTO #TestTable VALUES ('A', 1); -- duplicate
INSERT INTO #TestTable VALUES ('A', 1); -- duplicate
INSERT INTO #TestTable VALUES ('A', 2);
INSERT INTO #TestTable VALUES ('B', 1);
INSERT INTO #TestTable VALUES ('B', 2);
INSERT INTO #TestTable VALUES ('B', 2); -- duplicate
INSERT INTO #TestTable VALUES ('C', 1);
INSERT INTO #TestTable VALUES ('C', 2);

SELECT * FROM #TestTable ORDER BY Column1,Column2;

DELETE <your solution here>

SELECT * FROM #TestTable ORDER BY Column1,Column2;

回答1:

If all fields are identical, you can just do this:

select distinct * 
into #temp_table
from table_with_duplicates 

delete table_with_duplicates 

insert into table_with_duplicates select * from #temp_table

If all fields are not identical, for example, if you have an id that is different, then you'll need to list all the fields in the select statement, and hard code a value in the id to make it identical, if that is a field you don't care about. For example:

insert #temp_table field1, field2, id select (field1, field2, 999)
from table_with_duplicates

回答2:

This works well and fast:

DELETE FROM #TestTable
WHERE ROWID(#TestTable) IN (
  SELECT rowid FROM (
    SELECT ROWID(#TestTable) rowid, 
      ROW_NUMBER() OVER(PARTITION BY Column1,Column2 ORDER BY Column1,Column2) rownum
    FROM #TestTable
  ) sub
  WHERE rownum > 1
);

If you don't know OVER(PARTITION BY ...), just execute the inner SELECT statement to see what it does.

回答3:

Here is another interesting one I found and adopted:

DELETE FROM #TestTable dupes
FROM #TestTable dupes, #TestTable fullTable
WHERE dupes.Column1 = fullTable.Column1
  AND dupes.Column2 = fullTable.Column2
  AND ROWID(dupes) > ROWID(fullTable);

or, if you like explicit joins more (I do):

DELETE FROM #TestTable dupes
FROM #TestTable dupes
INNER JOIN #TestTable fullTable
  ON dupes.Column1 = fullTable.Column1
  AND dupes.Column2 = fullTable.Column2
  AND ROWID(dupes) > ROWID(fullTable);

or the short form (a "natural" join incorporates identical column names automatically):

DELETE FROM #TestTable dupes
FROM #TestTable dupes
NATURAL JOIN #TestTable fullTable
  ON ROWID(dupes) > ROWID(fullTable);

...if someone finds a solution not requiring ROWID(), I would be interested to see them.

回答4:

Please try this:

create clustered index i1 on table table_name(column_name) with ignore_dup_row

create table #test(id int,name char(9))
insert into #test values(1,"A")
insert into #test values(1,"A")
create clustered index i1 on #test(id) with ignore_dup_row
select * from #test

回答5:

Ok, now that I know the ROWID() function, solutions for tables with primary key (PK) can be easily adopted. This one first selects all rows to keep and then deletes the remaining ones:

DELETE FROM #TestTable
FROM #TestTable
LEFT OUTER JOIN (
  SELECT MIN(ROWID(#TestTable)) rowid
  FROM #TestTable
  GROUP BY Column1, Column2
) AS KeepRows ON ROWID(#TestTable) = KeepRows.rowid
WHERE KeepRows.rowid IS NULL;

...or how about this shorter variant? I like!

DELETE FROM #TestTable
WHERE ROWID(#TestTable) NOT IN (
  SELECT MIN(ROWID(#TestTable))
  FROM #TestTable
  GROUP BY Column1, Column2
);

In this post, which inspired me most, is a comment that NOT IN might be slower. But that's for SQL server, and sometimes elegance is more important :) - I also think it all depends on good indexes.

Anyway, usually it is bad design, to have tables without a PK. You should at least add an "autoinc" ID, and if you do, you can use that ID instead of the ROWID() function, which is a non-standard extension by Sybase (some others have it, too).

来源：https://stackoverflow.com/questions/19544489/how-to-delete-duplicate-rows-in-sybase-when-you-have-no-unique-key

标签

How to delete duplicate rows in sybase, when you have no unique key?

主宰稳场 — Tue, 14 Jan 2020 19:35:06 +0000

How to delete duplicate rows in sybase, when you have no unique key? 主宰稳场 2020-01-15 03:35:06

问题

One example for solutions I liked, but didn't work, is the WITH ... DELETE ... construct.

I have found working solutions using cursors or while-loops, but I hope it is possible without loops.

I hope for a nice, simple and fast query, just deleting all but one exact duplicate.

Here a little framework for testing:

IF OBJECT_ID( 'tempdb..#TestTable' ) IS NOT NULL
  DROP TABLE #TestTable;

CREATE TABLE #TestTable (Column1 varchar(1), Column2 int);

INSERT INTO #TestTable VALUES ('A', 1);
INSERT INTO #TestTable VALUES ('A', 1); -- duplicate
INSERT INTO #TestTable VALUES ('A', 1); -- duplicate
INSERT INTO #TestTable VALUES ('A', 2);
INSERT INTO #TestTable VALUES ('B', 1);
INSERT INTO #TestTable VALUES ('B', 2);
INSERT INTO #TestTable VALUES ('B', 2); -- duplicate
INSERT INTO #TestTable VALUES ('C', 1);
INSERT INTO #TestTable VALUES ('C', 2);

SELECT * FROM #TestTable ORDER BY Column1,Column2;

DELETE <your solution here>

SELECT * FROM #TestTable ORDER BY Column1,Column2;

回答1:

If all fields are identical, you can just do this:

select distinct * 
into #temp_table
from table_with_duplicates 

delete table_with_duplicates 

insert into table_with_duplicates select * from #temp_table

insert #temp_table field1, field2, id select (field1, field2, 999)
from table_with_duplicates

回答2:

This works well and fast:

DELETE FROM #TestTable
WHERE ROWID(#TestTable) IN (
  SELECT rowid FROM (
    SELECT ROWID(#TestTable) rowid, 
      ROW_NUMBER() OVER(PARTITION BY Column1,Column2 ORDER BY Column1,Column2) rownum
    FROM #TestTable
  ) sub
  WHERE rownum > 1
);

If you don't know OVER(PARTITION BY ...), just execute the inner SELECT statement to see what it does.

回答3:

Here is another interesting one I found and adopted:

DELETE FROM #TestTable dupes
FROM #TestTable dupes, #TestTable fullTable
WHERE dupes.Column1 = fullTable.Column1
  AND dupes.Column2 = fullTable.Column2
  AND ROWID(dupes) > ROWID(fullTable);

or, if you like explicit joins more (I do):

DELETE FROM #TestTable dupes
FROM #TestTable dupes
INNER JOIN #TestTable fullTable
  ON dupes.Column1 = fullTable.Column1
  AND dupes.Column2 = fullTable.Column2
  AND ROWID(dupes) > ROWID(fullTable);

or the short form (a "natural" join incorporates identical column names automatically):

DELETE FROM #TestTable dupes
FROM #TestTable dupes
NATURAL JOIN #TestTable fullTable
  ON ROWID(dupes) > ROWID(fullTable);

...if someone finds a solution not requiring ROWID(), I would be interested to see them.

回答4:

Please try this:

create clustered index i1 on table table_name(column_name) with ignore_dup_row

create table #test(id int,name char(9))
insert into #test values(1,"A")
insert into #test values(1,"A")
create clustered index i1 on #test(id) with ignore_dup_row
select * from #test

回答5:

Ok, now that I know the ROWID() function, solutions for tables with primary key (PK) can be easily adopted. This one first selects all rows to keep and then deletes the remaining ones:

DELETE FROM #TestTable
FROM #TestTable
LEFT OUTER JOIN (
  SELECT MIN(ROWID(#TestTable)) rowid
  FROM #TestTable
  GROUP BY Column1, Column2
) AS KeepRows ON ROWID(#TestTable) = KeepRows.rowid
WHERE KeepRows.rowid IS NULL;

...or how about this shorter variant? I like!

DELETE FROM #TestTable
WHERE ROWID(#TestTable) NOT IN (
  SELECT MIN(ROWID(#TestTable))
  FROM #TestTable
  GROUP BY Column1, Column2
);

In this post, which inspired me most, is a comment that NOT IN might be slower. But that's for SQL server, and sometimes elegance is more important :) - I also think it all depends on good indexes.

来源：https://stackoverflow.com/questions/19544489/how-to-delete-duplicate-rows-in-sybase-when-you-have-no-unique-key

标签

correlation name not found on SQL Anywhere

￣綄美尐妖づ — Sat, 11 Jan 2020 05:14:08 +0000

correlation name not found on SQL Anywhere ￣綄美尐妖づ 2020-01-11 13:14:08

问题

I have two tables called Employees and Salarygroup. PersonalID is the primary key of Employees and SalaryID is the primary key of Salarygroup. Inside the Employees table there is one more row called StartDat, which has date data type and tracks down the date when the employee started working at the company. Moreover, AmountInEuros is the salary that an employee gets every month and it has a numeric data type

I need to make a function, which count the total amount of money, that the employee has recieved so far from the company, but when I input the PersonalID I get an error saying *Correlation name 'Salarygroup' not found.

Could someone helo me understand why this is happening?

  ALTER FUNCTION "dba"."countTotalAmountOfMoney"(@PersonalID int)
   RETURNS int
   AS
   BEGIN
   DECLARE @totalAmountOfMoney int;
   SELECT  @totalAmountOfMoney = g.AmountInEuros * DATEDIFF(month, g.StartDat, 
        '2019-01-16') 
   FROM dba.Employees 
   Inner Join dba.Salarygroup s
   ON   dba.Employees.SalaryId = dba.Salarygroup.SalaryId

   RETURN @totalAmountOfMoney;
END

回答1:

You have given the table an alias, so you need to use it. I would recommend using aliases for all the tables:

DECLARE @totalAmountOfMoney int;

SELECT @totalAmountOfMoney = s.AmountInEuros * DATEDIFF(month, e.StartDat, '2019-01-16') 
FROM dba.Employees e INNER JOIN
     dba.Salarygroup s
     ON e.SalaryId = s.SalaryId
WHERE e.personalID = @PersonalID;

Note that the g alias is not defined in your query. StartDat comes from Employees, so I changed that to e. I am guessing that AmountInEuros comes from s.

回答2:

Maybe you forgotten to refer the second table using the Alias 's' you created:

ALTER FUNCTION "dba"."countTotalAmountOfMoney"(@PersonalID int)
   RETURNS int
   AS
   BEGIN
   DECLARE @totalAmountOfMoney int;
   SELECT  @totalAmountOfMoney = g.AmountInEuros * DATEDIFF(month, g.StartDat, 
        '2019-01-16') 
   FROM dba.Employees 
   Inner Join dba.Salarygroup s
   ON   dba.Employees.SalaryId = s.SalaryId

   RETURN @totalAmountOfMoney;
END

来源：https://stackoverflow.com/questions/54199732/correlation-name-not-found-on-sql-anywhere

标签

tsql

sql-function

sqlanywhere

Sybase database password “recovery”

穿精又带淫゛_ — Sat, 04 Jan 2020 09:29:27 +0000

Sybase database password “recovery” 穿精又带淫゛_ 2020-01-04 17:29:27

问题

I have DBA authority to a sybase database on Windows.

I have a another user that I don't know the password for.

I regularly use an application that does know the password, and it uses the password to automatically login to the application. However, I can't find a way to find that password anywhere in the application or its dlls/files/registry/etc.

I obviously don't want to just change the password of the user, as the password in the application can't be updated (that i know of).

I want to be able to login to the database as this user.

Are there any logging settings for the database server that will log the password in plaintext? Or any other methods I can use to obtain the password (maybe via login_procedure)? I'd also be okay with just obtaining the hash for the password(+salt).

回答1:

There is no SAP Sybase supported way to get the password in plaintext. You can view the hashed password by querying master..syslogins.passwords column.

A possible workaround would be to create a new user, and alias them to user in question inside the database.

sp_addalias is the command you would use to do something like that.

You can view the hashed password

回答2:

You can't get the plaintext password as it's not logged anywhere and we don't store it. What's stored in the ISYSUSER system table is the SHA-256 hash of the password, and so it is not possible to get the password from it. (And it's not the hash of just the password - it includes a random salt.)

However, if you have DBA authority, you can do anything in the database anyway. If you need to be connected as that particular user, you can connect as the user with DBA authority and then use the SETUSER statement.

Disclaimer: I work for SAP in SQL Anywhere engineering.

回答3:

Another option might be to decompile the application program and look for the password. I don't know who in their right mind would hard code a password into program code, but it kind of sounds like that is what happened here? Alternatively, if it is an internally-developed app, do you have access to the source code?

If that is what happened, and you have the ability to recompile the app, use the keyring (Mac, Linux) or DPAPI (Windows) to securely (as much as possible) store an encrypted instance of the password outside the application code. You'll be able to change it, and some random person who manages to hack in and get access to the source code or binary won't be able to inspect the program like I'm suggesting you try.

I also realize this is an old post and you've either solved the problem or moved on by now. ;-)

来源：https://stackoverflow.com/questions/21101024/sybase-database-password-recovery

标签

Python list of ints in prepared sql statement

妖精的绣舞 — Mon, 30 Dec 2019 14:52:34 +0000

Python list of ints in prepared sql statement 妖精的绣舞 2019-12-30 22:52:34

问题

My question is somewhat the same as Python list of String to SQL IN parameter but I have a list of integers. The python code I use is:

ids = [1000032, 1000048]
sql = 'SELECT CompNo, CompName, CompType FROM Component WHERE DeptID IN (?)'    
cursor.execute(sql, [','.join(ids)])

And the Sybase database engine responds with:

pyodbc.Error: ('07006', "[07006] [Sybase][ODBC Driver][SQL Anywhere]Cannot convert '1000032','1000048' to a numeric (-157) (SQLExecDirectW)")

What is the correct way to do this?

回答1:

IMO a more readable way to build a dynamic query string with placeholders using str.format

ids = [1000032, 1000048]
sql = 'SELECT CompNo, CompName, CompType FROM Component WHERE DeptID IN ({0})' 
sql = sql.format(','.join('?' * len(ids)))
cursor.execute(sql, (ids,))
...

回答2:

You cannot provide the IN-list as one argument. You need to provide the exact number of place holders in the SQL IN clause, and then provide the array to the execute method:

ids = [1000032, 1000048]
sql = 'SELECT CompNo, CompName, CompType FROM Component WHERE DeptID IN (' \
       + (',?' * len(ids))[1:] + ')'
cursor.execute(sql, ids)

回答3:

you should cast the array of int to array of strings:

",".join(map(str,ids))

来源：https://stackoverflow.com/questions/35061730/python-list-of-ints-in-prepared-sql-statement

标签