Unexpected error in notifyUser

rvkvino

[PHP]03-Jul-20 07:23:00,595|INFO |L.requests |SERVER POOLED THREAD 5 |Serving request: /lightstreamer/create_session.js --> LS_op2=create&LS_phase=7175&LS_cause=failure.status0&LS_polling=true&LS_polling_millis=0&LS_idle_millis=0&LS_cid=pcYgxn8m8 feOojyA1T661j3g2.pz479h7m&LS_adapter_set=WLSTOCKLIST_REMOTE&LS_container=lsc& on "Lightstreamer HTTP Server" from 1.23.1.245:6296203-Jul-20 07:23:00,595|ERROR|L.requests |SERVER POOLED THREAD 5 |Unexpected error in notifyUser: Connection closed while facing request d9000001731456c5df:03-Jul-20 07:23:00,595|ERROR|L.connections |SERVER POOLED THREAD 5 |Failure in request processing: External error while managing the request: Unexpected error in notifyUser: Connection closed while facing request d9000001731456c5df.[/PHP]

I have installed LS server in Linux centos 7 and I have started LS server and my remoter adapter. When I check connecting LS server and adapter with my client it's showing the error like

Request URL:
http://209.59.158.15:8080/lightstreamer/create_session.js
Request Method:
POST
Status Code:
500 Internal Server Error
Remote Address:
209.59.158.15:8080

My notifyuser method looks like,
[PHP]public void notifyUser(String user, String password, Map<String, String> httpHeaders) throws AccessException { String origin = httpHeaders.get("origin"); String un = httpHeaders.get("username");
if ((origin == null) || VALUES.contains(origin)) { if ((un == null) || !un.equalsIgnoreCase("lmxwinbulllite")) { throw new AccessException("Invalid User Access"); } } else { if ((un == null) || !un.equalsIgnoreCase("lmxwinbullliteapp")) { throw new AccessException("Invalid User Access"); } }
}[/PHP]

Can you please help me on this what might be the issue?

Giuseppe Corti

Hi,

First I would check if http headers are actually present in the request and reach your adapter.
Can you add some logs to your adapter to view the values for origin and un?

rvkvino

In my client I have added,

var lsClient = new LightstreamerClient(lsdata.url,lsdata.adapter);
lsClient.connectionOptions.setHttpExtraHeaders({"username" : lsdata.username});
lsClient.connectionOptions.setHttpExtraHeadersOnSessionCreationOnly(true);
lsClient.connect();
return lsClient;

Lightstreamer.log

03-Jul-20 06:50:22,136|INFO |L.requests 03-Jul-20 06:50:22,137|ERROR|L.requests 03-Jul-20 06:50:22,137|ERROR|L.connections 03-Jul-20 06:50:27,131|INFO |L.requests 03-Jul-20 06:50:27,131|ERROR|L.requests 03-Jul-20 06:50:27,131|ERROR|L.connections 03-Jul-20 06:50:32,140|INFO |L.requests 03-Jul-20 06:50:32,140|ERROR|L.requests 03-Jul-20 06:50:32,140|ERROR|L.connections 03-Jul-20 06:50:37,143|INFO |L.requests 03-Jul-20 06:50:37,143|ERROR|L.requests 03-Jul-20 06:50:37,143|ERROR|L.connections 03-Jul-20 06:50:42,138|INFO |L.requests 03-Jul-20 06:50:42,138|ERROR|L.requests 03-Jul-20 06:50:42,139|ERROR|L.connections 03-Jul-20 06:50:47,145|INFO |L.requests 03-Jul-20 06:50:47,145|ERROR|L.requests 03-Jul-20 06:50:47,145|ERROR|L.connections 03-Jul-20 06:50:52,129|INFO |L.requests 03-Jul-20 06:50:52,129|ERROR|L.requests 03-Jul-20 06:50:52,129|ERROR|L.connections 03-Jul-20 06:50:54,928|INFO |streamerMo |SERVER POOLED THREAD 3 |Serving request: /lightstreamer/create_session.js --> LS_op2=create&LS_phase=7633&LS_cause=failure.status0&LS_polling=true&LS_polling_millis=0&LS_idle_millis=0&LS_cid=pcYgxn8m8 feOojyA1T661j3g2.pz479h7m&LS_adapter_set=WLSTOCKLIST_REMOTE&LS_container=lsc& on "Lightstreamer HTTP Server" from 1.23.1.245:60401
|SERVER POOLED THREAD 3 |Unexpected error in notifyUser: Connection closed while facing request 4f0000001731374a7e4:
|SERVER POOLED THREAD 3 |Failure in request processing: External error while managing the request: Unexpected error in notifyUser: Connection closed while facing request 4f0000001731374a7e4.
|SERVER POOLED THREAD 3 |Serving request: /lightstreamer/create_session.js --> LS_op2=create&LS_phase=7635&LS_cause=nullresp&LS_polling=true&LS_polling_millis=0&LS_idle_millis=0&LS_cid=pcYgxn8m8 feOojyA1T661j3g2.pz479h7m&LS_adapter_set=WLSTOCKLIST_REMOTE&LS_container=lsc& on "Lightstreamer HTTP Server" from 1.23.1.245:60405
|SERVER POOLED THREAD 3 |Unexpected error in notifyUser: Connection closed while facing request 4f1000001731374a7e4:
|SERVER POOLED THREAD 3 |Failure in request processing: External error while managing the request: Unexpected error in notifyUser: Connection closed while facing request 4f1000001731374a7e4.
|SERVER POOLED THREAD 3 |Serving request: /lightstreamer/create_session.js --> LS_op2=create&LS_phase=7637&LS_cause=nullresp&LS_polling=true&LS_polling_millis=0&LS_idle_millis=0&LS_cid=pcYgxn8m8 feOojyA1T661j3g2.pz479h7m&LS_adapter_set=WLSTOCKLIST_REMOTE&LS_container=lsc& on "Lightstreamer HTTP Server" from 1.23.1.245:60409
|SERVER POOLED THREAD 3 |Unexpected error in notifyUser: Connection closed while facing request 4f2000001731374a7e4:
|SERVER POOLED THREAD 3 |Failure in request processing: External error while managing the request: Unexpected error in notifyUser: Connection closed while facing request 4f2000001731374a7e4.
|SERVER POOLED THREAD 3 |Serving request: /lightstreamer/create_session.js --> LS_op2=create&LS_phase=7639&LS_cause=nullresp&LS_polling=true&LS_polling_millis=0&LS_idle_millis=0&LS_cid=pcYgxn8m8 feOojyA1T661j3g2.pz479h7m&LS_adapter_set=WLSTOCKLIST_REMOTE&LS_container=lsc& on "Lightstreamer HTTP Server" from 1.23.1.245:60414
|SERVER POOLED THREAD 3 |Unexpected error in notifyUser: Connection closed while facing request 4f3000001731374a7e4:
|SERVER POOLED THREAD 3 |Failure in request processing: External error while managing the request: Unexpected error in notifyUser: Connection closed while facing request 4f3000001731374a7e4.
|SERVER POOLED THREAD 3 |Serving request: /lightstreamer/create_session.js --> LS_op2=create&LS_phase=7641&LS_cause=nullresp&LS_polling=true&LS_polling_millis=0&LS_idle_millis=0&LS_cid=pcYgxn8m8 feOojyA1T661j3g2.pz479h7m&LS_adapter_set=WLSTOCKLIST_REMOTE&LS_container=lsc& on "Lightstreamer HTTP Server" from 1.23.1.245:60420
|SERVER POOLED THREAD 3 |Unexpected error in notifyUser: Connection closed while facing request 4f4000001731374a7e4:
|SERVER POOLED THREAD 3 |Failure in request processing: External error while managing the request: Unexpected error in notifyUser: Connection closed while facing request 4f4000001731374a7e4.
|SERVER POOLED THREAD 3 |Serving request: /lightstreamer/create_session.js --> LS_op2=create&LS_phase=7643&LS_cause=nullresp&LS_polling=true&LS_polling_millis=0&LS_idle_millis=0&LS_cid=pcYgxn8m8 feOojyA1T661j3g2.pz479h7m&LS_adapter_set=WLSTOCKLIST_REMOTE&LS_container=lsc& on "Lightstreamer HTTP Server" from 1.23.1.245:60426
|SERVER POOLED THREAD 3 |Unexpected error in notifyUser: Connection closed while facing request 4f5000001731374a7e4:
|SERVER POOLED THREAD 3 |Failure in request processing: External error while managing the request: Unexpected error in notifyUser: Connection closed while facing request 4f5000001731374a7e4.
|SERVER POOLED THREAD 3 |Serving request: /lightstreamer/create_session.js --> LS_op2=create&LS_phase=7645&LS_cause=nullresp&LS_polling=true&LS_polling_millis=0&LS_idle_millis=0&LS_cid=pcYgxn8m8 feOojyA1T661j3g2.pz479h7m&LS_adapter_set=WLSTOCKLIST_REMOTE&LS_container=lsc& on "Lightstreamer HTTP Server" from 1.23.1.245:60432
|SERVER POOLED THREAD 3 |Unexpected error in notifyUser: Connection closed while facing request 4f6000001731374a7e4:
|SERVER POOLED THREAD 3 |Failure in request processing: External error while managing the request: Unexpected error in notifyUser: Connection closed while facing request 4f6000001731374a7e4.
nitorText|Timer-1 |Total threads = 96, Total heap = 62914560 (free = 43982112), Sessions = 1 (max = 2, refused = 0), New sessions = [+0, -0], Connections = 1 (max = 11), New connections = [+22, -22], In-pool threads = 32, Active threads = 0, Available threads = 32, Queued tasks = 0, Pool queue wait = 0, NIO write queue = 0, NIO write queue wait = 0, NIO write selectors = 4, NIO total selectors = 16, Subscribed items = 9 (for 9 subscriptions), Inbound throughput = 12.99 updates/s (pre-filtered = 12.99), Outbound throughput = 2.5 updates/s (1.77 kbit/s, max = 7.16), Lost updates = 0 (total = 0), Total bytes sent = 378910, Client messages throughput = 0 msgs/s (0 kbit/s, max = 0.08), Total messages handled = 5, Extra sleep = 0, Notify delay = 0

Giuseppe Corti

Please could you leverage the following log settings:

<logger name="LightstreamerLogger.connections" level="DEBUG"/>
<logger name="LightstreamerLogger.connections.http" level="DEBUG"/>

With these changes you will be able to verify the http headers of the client requests.
Please also note that the log will be very verbose, so use them only for a while during your tests.

rvkvino

Hello,
I think my adapter is not running correctly by using my sh script.
In my windows machine batch file for my adapter running is,

TITLE WINBULLLITE
set cpath=D:/Lightstreamer/adapters/WINLITERemoteStockList/classes/ls-adapter-remote.jar;D:/Lightstreamer/adapters/WINLITERemoteStockList/classes/java-json.jar;D:/Lightstreamer/adapters/WINLITERemoteStockList/classes/jedis.jar;D:/Lightstreamer/adapters/WINLITERemoteStockList/classes/gson.jar;D:/Lightstreamer/adapters/WINLITERemoteStockList/classes/LS_quote_feed_simulator.jar
set class=stocklist.server.ServerMain

set command=java -cp %cpath% %class% -host localhost -metadata_rrport 6722 -data_rrport 6720 -data_notifport 6721

%command%
pause

Same above bat file I have converted as

set cpath=/home/postnammauzhavan/Lightstreamer/adapters/WINLITERemoteStockList/classes/ls-adapter-remote.jar:/home/postnammauzhavan/Lightstreamer/adapters/WINLITERemoteStockList/classes/jedis.jar:/home/postnammauzhavan/Lightstreamer/adapters/WINLITERemoteStockList/classes/gson.jar:/home/postnammauzhavan/Lightstreamer/adapters/WINLITERemoteStockList/classes/LS_quote_feed_simulator.jar
set class=stocklist.server.ServerMain

set command=java -cp $cpath $class -host localhost -metadata_rrport 6722 -data_rrport 6720 -data_notifport 6721

$command
sleep 10

I have doubt whether I have converted script correct or not. And also I don't know the use of sleep 10.
And finally I had run this sh script like bash linuxwinbulllite.sh & to run my sh script in background. Now I'm having doubt whether this is running or not. Could you please help me to check whether adapter is running whether without issue in centos 7. In windows OS I can check in batch window screen whether adapter running correct or not. But I don't know how to check in centos 7 by using putty.

New log is,

03-Jul-20 11:35:57,702|DEBUG|L.connections.http |SERVER POOLED THREAD 10 |Writing response:
HTTP/1.1 500 Internal Server Error
Server: Lightstreamer-Server/7.1.1 build 1973 (Lightstreamer Server - www.lightstreamer.com) COMMUNITY edition
Date: Fri, 3 Jul 2020 15:35:57 GMT
Content-Length: 0
Connection: close
Access-Control-Allow-Origin: http://www.bullionsoftware.com
Access-Control-Allow-Credentials: true
x-accel-buffering: no

on "Lightstreamer HTTP Server" from 1.23.1.245:64933
03-Jul-20 11:35:57,702|INFO |L.connections |SERVER POOLED THREAD 10 |Closed HTTP connection with internal cause code: 0 (Terminated) on "Lightstreamer HTTP Server" from 1.23.1.245:64933
03-Jul-20 11:36:02,705|DEBUG|L.connections |r Lightstreamer HTTP Server|Socket accept from 1.23.1.245:64939
03-Jul-20 11:36:02,705|INFO |L.connections |ACCEPT POOLED THREAD 3 |Accepted HTTP connection on "Lightstreamer HTTP Server" from 1.23.1.245:64939
03-Jul-20 11:36:02,707|INFO |L.connections.http |ACCEPT POOLED THREAD 3 |Using charset ISO-8859-1 for content type application/x-www-form-urlencoded
03-Jul-20 11:36:02,707|DEBUG|L.connections |ACCEPT POOLED THREAD 3 |Got simple body block of size 193
03-Jul-20 11:36:02,707|DEBUG|L.connections.http |ACCEPT POOLED THREAD 3 |Parsing request:
POST /lightstreamer/create_session.js HTTP/1.1
Accept: */*
Accept-Encoding: gzip, deflate
Accept-Language: en-US,en;q=0.9,ta;q=0.8
Connection: keep-alive
Content-Length: 193
Content-Type: application/x-www-form-urlencoded
Host: 209.59.158.15:8080
Origin: http://www.bullionsoftware.com
Referer: http://www.bullionsoftware.com/win_trade/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.97 Safari/537.36
username: lmxwinbulllite

LS_op2=create&LS_phase=9629&LS_cause=nullresp&LS_polling=true&LS_polling_millis=0&LS_idle_millis=0&LS_cid=pcYgxn8m8 feOojyA1T661j3g2.pz479h7m&LS_adapter_set=WLSTOCKLIST_REMOTE&LS_container=lsc& on "Lightstreamer HTTP Server" from 1.23.1.245:64939
03-Jul-20 11:36:02,707|DEBUG|L.connections |ACCEPT POOLED THREAD 3 |Processing push request:
/lightstreamer/create_session.js on "Lightstreamer HTTP Server" from 1.23.1.245:64939
03-Jul-20 11:36:02,709|INFO |L.requests |SERVER POOLED THREAD 8 |Serving request: /lightstreamer/create_session.js --> LS_op2=create&LS_phase=9629&LS_cause=nullresp&LS_polling=true&LS_polling_millis=0&LS_idle_millis=0&LS_cid=pcYgxn8m8 feOojyA1T661j3g2.pz479h7m&LS_adapter_set=WLSTOCKLIST_REMOTE&LS_container=lsc& on "Lightstreamer HTTP Server" from 1.23.1.245:64939
03-Jul-20 11:36:02,712|ERROR|L.requests |SERVER POOLED THREAD 8 |Unexpected error in notifyUser: Connection closed while facing request 120000017315508cc0:
03-Jul-20 11:36:02,712|INFO |L.connections |SERVER POOLED THREAD 8 |Failed request on "Lightstreamer HTTP Server" from 1.23.1.245:64939
03-Jul-20 11:36:02,712|ERROR|L.connections |SERVER POOLED THREAD 8 |Failure in request processing: External error while managing the request: Unexpected error in notifyUser: Connection closed while facing request 120000017315508cc0.
03-Jul-20 11:36:02,713|DEBUG|L.connections.http |SERVER POOLED THREAD 8 |Writing response:
HTTP/1.1 500 Internal Server Error
Server: Lightstreamer-Server/7.1.1 build 1973 (Lightstreamer Server - www.lightstreamer.com) COMMUNITY edition
Date: Fri, 3 Jul 2020 15:36:02 GMT
Content-Length: 0
Connection: close
Access-Control-Allow-Origin: http://www.bullionsoftware.com
Access-Control-Allow-Credentials: true
x-accel-buffering: no

on "Lightstreamer HTTP Server" from 1.23.1.245:64939
03-Jul-20 11:36:02,713|INFO |L.connections |SERVER POOLED THREAD 8 |Closed HTTP connection with internal cause code: 0 (Terminated) on "Lightstreamer HTTP Server" from 1.23.1.245:64939
03-Jul-20 11:36:07,706|DEBUG|L.connections |r Lightstreamer HTTP Server|Socket accept from 1.23.1.245:64947
03-Jul-20 11:36:07,707|INFO |L.connections |ACCEPT POOLED THREAD 3 |Accepted HTTP connection on "Lightstreamer HTTP Server" from 1.23.1.245:64947
03-Jul-20 11:36:07,707|INFO |L.connections.http |ACCEPT POOLED THREAD 3 |Using charset ISO-8859-1 for content type application/x-www-form-urlencoded
03-Jul-20 11:36:07,707|DEBUG|L.connections |ACCEPT POOLED THREAD 3 |Got simple body block of size 193
03-Jul-20 11:36:07,707|DEBUG|L.connections.http |ACCEPT POOLED THREAD 3 |Parsing request:
POST /lightstreamer/create_session.js HTTP/1.1
Accept: */*
Accept-Encoding: gzip, deflate
Accept-Language: en-US,en;q=0.9,ta;q=0.8
Connection: keep-alive
Content-Length: 193
Content-Type: application/x-www-form-urlencoded
Host: 209.59.158.15:8080
Origin: http://www.bullionsoftware.com
Referer: http://www.bullionsoftware.com/win_trade/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.97 Safari/537.36
username: lmxwinbulllite

LS_op2=create&LS_phase=9631&LS_cause=nullresp&LS_polling=true&LS_polling_millis=0&LS_idle_millis=0&LS_cid=pcYgxn8m8 feOojyA1T661j3g2.pz479h7m&LS_adapter_set=WLSTOCKLIST_REMOTE&LS_container=lsc& on "Lightstreamer HTTP Server" from 1.23.1.245:64947
03-Jul-20 11:36:07,707|DEBUG|L.connections |ACCEPT POOLED THREAD 3 |Processing push request:
/lightstreamer/create_session.js on "Lightstreamer HTTP Server" from 1.23.1.245:64947
03-Jul-20 11:36:07,708|INFO |L.requests |SERVER POOLED THREAD 8 |Serving request: /lightstreamer/create_session.js --> LS_op2=create&LS_phase=9631&LS_cause=nullresp&LS_polling=true&LS_polling_millis=0&LS_idle_millis=0&LS_cid=pcYgxn8m8 feOojyA1T661j3g2.pz479h7m&LS_adapter_set=WLSTOCKLIST_REMOTE&LS_container=lsc& on "Lightstreamer HTTP Server" from 1.23.1.245:64947
03-Jul-20 11:36:07,709|ERROR|L.requests |SERVER POOLED THREAD 8 |Unexpected error in notifyUser: Connection closed while facing request 130000017315508cc0:
03-Jul-20 11:36:07,709|INFO |L.connections |SERVER POOLED THREAD 8 |Failed request on "Lightstreamer HTTP Server" from 1.23.1.245:64947
03-Jul-20 11:36:07,709|ERROR|L.connections |SERVER POOLED THREAD 8 |Failure in request processing: External error while managing the request: Unexpected error in notifyUser: Connection closed while facing request 130000017315508cc0.
03-Jul-20 11:36:07,709|DEBUG|L.connections.http |SERVER POOLED THREAD 8 |Writing response:
HTTP/1.1 500 Internal Server Error
Server: Lightstreamer-Server/7.1.1 build 1973 (Lightstreamer Server - www.lightstreamer.com) COMMUNITY edition
Date: Fri, 3 Jul 2020 15:36:07 GMT
Content-Length: 0
Connection: close
Access-Control-Allow-Origin: http://www.bullionsoftware.com
Access-Control-Allow-Credentials: true
x-accel-buffering: no

on "Lightstreamer HTTP Server" from 1.23.1.245:64947
03-Jul-20 11:36:07,709|INFO |L.connections |SERVER POOLED THREAD 8 |Closed HTTP connection with internal cause code: 0 (Terminated) on "Lightstreamer HTTP Server" from 1.23.1.245:64947

Giuseppe Corti

Hi,

The server log confirms that http headers Origin and username are valued in the request parsed by the server.
Please be sure that the values are something you expect.

Origin: [url]http://www.bullionsoftware.com[/url]
username: lmxwinbulllite

About the Adapters, you could check the server log looking for messages regarding the remote adapters connections and initialization; something like this:

06-Jul-20 09:55:42,243|INFO |L.S.Q.transport * *|pool-2-thread-1 * * * * * *|Accepted connection (1) on the Notify socket on port 6662 from /127.0.0.1:58633
06-Jul-20 09:55:42,243|INFO |L.S.Q.transport * *|pool-3-thread-1 * * * * * *|Accepted connection (1) on the Request/Reply socket on port 6661 from /127.0.0.1:58631
06-Jul-20 09:55:42,243|INFO |L.S.transport * * *|pool-4-thread-1 * * * * * *|Accepted connection (1) on the Request/Reply socket on port 6663 from /127.0.0.1:58632
06-Jul-20 09:55:42,259|INFO |L.S.Q.r.notify * * |OTE_ADAPTER Notify Receiver|Notify receiver 'STOCKLISTDEMO_REMOTE.QUOTE_ADAPTER-1' starting...
06-Jul-20 09:55:42,274|INFO |L.S.Q.sender * * * |UOTE_ADAPTER Request Sender|Request sender 'STOCKLISTDEMO_REMOTE.QUOTE_ADAPTER-1' starting...
06-Jul-20 09:55:42,276|INFO |L.S.Q.r.reply * * *|UOTE_ADAPTER Reply Receiver|Reply receiver 'STOCKLISTDEMO_REMOTE.QUOTE_ADAPTER-1' starting...
06-Jul-20 09:55:42,278|INFO |L.S.sender * * * * |TDEMO_REMOTE Request Sender|Request sender 'STOCKLISTDEMO_REMOTE-1' starting...
06-Jul-20 09:55:42,280|INFO |L.S.receiver.reply |TDEMO_REMOTE Reply Receiver|Reply receiver 'STOCKLISTDEMO_REMOTE-1' starting...
06-Jul-20 09:55:42,282|INFO |L.S.Q.transport * *|pool-2-thread-1 * * * * * *|Connected (1) *on port 6662 from /127.0.0.1:58633
06-Jul-20 09:55:42,282|INFO |L.S.Q.transport * *|pool-3-thread-1 * * * * * *|Connected (1) *on port 6661 from /127.0.0.1:58631
06-Jul-20 09:55:42,282|INFO |L.S.Q.transport * *|pool-2-thread-1 * * * * * *|Stopped waiting on port 6662
06-Jul-20 09:55:42,283|INFO |L.S.transport * * *|pool-4-thread-1 * * * * * *|Connected (1) *on port 6663 from /127.0.0.1:58632
06-Jul-20 09:55:42,283|INFO |L.S.Q.transport * *|STDEMO_REMOTE.QUOTE_ADAPTER|Stopped waiting on port 6661
06-Jul-20 09:55:42,284|INFO |L.S.Q.transport * *|pool-3-thread-1 * * * * * *|Stopped waiting on port 6661
06-Jul-20 09:55:42,285|INFO |L.S.transport * * *|pool-4-thread-1 * * * * * *|Stopped waiting on port 6663
06-Jul-20 09:55:42,285|INFO |L.S.transport * * *|it for STOCKLISTDEMO_REMOTE|Stopped waiting on port 6663
06-Jul-20 09:55:42,285|INFO |L.S.Q.transport * *|STDEMO_REMOTE.QUOTE_ADAPTER|Connected
06-Jul-20 09:55:42,289|INFO |L.S.transport * * *|it for STOCKLISTDEMO_REMOTE|Connected
06-Jul-20 09:55:42,323|INFO |L.init * * * * * * |it for STOCKLISTDEMO_REMOTE|Finished loading Metadata Adapter for Adapter Set STOCKLISTDEMO_REMOTE
06-Jul-20 09:55:42,333|INFO |L.init * * * * * * |STDEMO_REMOTE.QUOTE_ADAPTER|Finished loading Data Adapter STOCKLISTDEMO_REMOTE.QUOTE_ADAPTER

Obviously in your case the names of the adapters and the ports number will be different.

Regards,
Giuseppe

rvkvino

Hello,
I have checked well in all the places I didn't use port 6661, 6662 and 6663
I have used the port 6720, 6721 and 6722 and my adapter looks like,

<?xml version="1.0"?>

<adapters_conf id="WLSTOCKLIST_REMOTE">
<metadata_adapter_initialised_first>N</metadata_adapter_initialised_first>
<metadata_provider>
<adapter_class>com.lightstreamer.adapters.remote.metadata.RobustNetworkedMetadataProvider</adapter_class>
<classloader>log-enabled</classloader>
<param name="request_reply_port">6722</param>
<param name="connection_recovery_timeout_millis">10000</param>
<param name="first_connection_timeout_millis">10000</param>
<param name="close_notifications_recovery">unneeded</param>
</metadata_provider>
<data_provider name="WLQUOTE_ADAPTER">
<adapter_class>com.lightstreamer.adapters.remote.data.RobustNetworkedDataProvider</adapter_class>
<classloader>log-enabled</classloader>
<param name="request_reply_port">6720</param>
<param name="notify_port">6721</param>
<param name="connection_recovery_timeout_millis">10000</param>
<param name="events_recovery">use_snapshot</param>
</data_provider>

</adapters_conf>

And my adapter starting shell script file looks like,

set cpath=/home/postnu/Lightstreamer/adapters/WINLITERemoteStockList/classes/ls-adapter-remote.jar:/home/postnu/Lightstreamer/adapters/WINLITERemoteStockList/classes/jedis.jar:/home/postnu/Lightstreamer/adapters/WINLITERemoteStockList/classes/gson.jar:/home/postnu/Lightstreamer/adapters/WINLITERemoteStockList/classes/LS_quote_feed_simulator.jar
set class=stocklist.server.ServerMain

set command=java -cp $cpath $class -host localhost -metadata_rrport 6722 -data_rrport 6720 -data_notifport 6721

$command
sleep 10

Giuseppe Corti

Ok, you should check your server log looking for messages like these:

Accepted connection (1) on the Notify socket on port 6721 from ...
Accepted connection (1) on the Request/Reply socket on port 6720 from ...
Accepted connection (1) on the Request/Reply socket on port 6722 from ...

To be sure that your adapters can get started properly and connected to the server.

Regards,
Giuseppe

rvkvino

I have checked and mentioned the log below,

06-Jul-20 06:28:33,211|ERROR|L.connections |SERVER POOLED THREAD 10 |Failure in request processing: External error while managing the request: Unexpected error in notifyUser: Connection closed while facing request 1d80000017323535e3e.
06-Jul-20 06:28:38,211|INFO |L.requests |SERVER POOLED THREAD 10 |Serving request: /lightstreamer/create_session.js --> LS_op2=create&LS_phase=6721&LS_cause=nullresp&LS_polling=true&LS_polling_millis=0&LS_idle_millis=0&LS_cid=pcYgxn8m8 feOojyA1T661j3g2.pz479h7m&LS_adapter_set=WLSTOCKLIST_REMOTE&LS_container=lsc& on "Lightstreamer HTTP Server" from 1.22.24.58:55214
06-Jul-20 06:28:38,212|ERROR|L.requests |SERVER POOLED THREAD 10 |Unexpected error in notifyUser: Connection closed while facing request 1d90000017323535e3e:

But I couldn't see Accepted connection (1) on the Notify socket on port 6721 from like this.

But this same adapter working in my windows machine but not working in centos 7. Whether any changes need to do while running adapter in centos.

Giuseppe Corti

Have you tried launching the script from a shell? Have you noticed any error messages?

However, an example of a java adapter launch script for linux that you can use as a reference can be found in the deploy.zip file here: https://github.com/Lightstreamer/Lightstreamer-example-StockList-adapter-java-remote/releases/tag/1.4.0

rvkvino

I have followed this only already, but when I use ; this didn't work so that I changed to ":"

My shell script looks like

set cpath=/home/postnammauzhavan/Lightstreamer/adapters/WINLITERemoteStockList/classes/ls-adapter-remote.jar:/home/postnammauzhavan/Lightstreamer/adapters/WINLITERemoteStockList/classes/jedis.jar:/home/postnammauzhavan/Lightstreamer/adapters/WINLITERemoteStockList/classes/gson.jar:/home/postnammauzhavan/Lightstreamer/adapters/WINLITERemoteStockList/classes/LS_quote_feed_simulator.jar
set class=stocklist.server.ServerMain

set command="java -cp $cpath $class -host localhost -metadata_rrport 6722 -data_rrport 6720 -data_notifport 6721"
exec $command

When I run this above sh file using bash linuxwinbulllite.sh & the below showing as result. There is no issues on my script to run adapter. But when I check log there is nothing showing as Accepted connection.

[root@cloudvpsserver unix-like]# bash linuxwinbulllite.sh &
[1] 46076
[1]+ Done bash linuxwinbulllite.sh

07-Jul-20 00:37:13,875|INFO |L.requests |SERVER POOLED THREAD 4 |Serving request: /lightstreamer/create_session.js --> LS_op2=create&LS_phase=5513&LS_cause=nullresp&LS_polling=true&LS_polling_millis=0&LS_idle_millis=0&LS_cid=pcYgxn8m8 feOojyA1T661j3g2.pz479h7m&LS_adapter_set=WLSTOCKLIST_REMOTE&LS_container=lsc& on "Lightstreamer HTTP Server" from 1.23.1.117:50020

Giuseppe Corti

Could you add a very simple log to file in your adapters? Just to understand what is going on.

rvkvino

Can you please help me on this how to add log in my adapter.
@Override
public void subscribe(String itemName) throws SubscriptionException, FailureException {
logger.debug("Subscribing to " + itemName);
}
Is this okay or I add some other things. But when I check in my log file I couldn't find the Subscribing to in my log file.

Dario Crivelli

The log you perform in your code should be entirely managed by your code, without Lightstreamer involvement
(although the java remote SDK also provides a very simple logging interface).
For instance if your "logger" object is obtained with slf4j, you should provide a suitable slf4j implementation and configuration.

However, Giuseppe's advise was to log the startup phase of the process, when the process tries to establish a connection with Lightstreamer Server, since there is no evidence of such connection.
As log as the remote adapter process fails to connect, it won't receive any invocation of "subscribe", hence it is correct that you can't see this log.

rvkvino

Hello,
Finally find out the issue, I have modified my shell script as like below,

cpath="/home/postnammauzhavan/Lightstreamer/adapters/WINLITERemoteStockList/classes/ls-adapter-remote.jar:/home/postnammauzhavan/Lightstreamer/adapters/WINLITERemoteStockList/classes/jedis.jar:/home/postnammauzhavan/Lightstreamer/adapters/WINLITERemoteStockList/classes/gson.jar:/home/postnammauzhavan/Lightstreamer/adapters/WINLITERemoteStockList/classes/LS_quote_feed_simulator.jar"
class="stocklist.server.ServerMain"

command="java -cp $cpath $class -host localhost -metadata_rrport 6722 -data_rrport 6720 -data_notifport 6721"
exec $command $

It seems need to give values within double quote.

Now I have an issue on getting update from redis and serve this data to subscribed items.
I have used redis instance on ExternalFeedSimulator java class. Can you please on this where I need to create instance and where to close the redis exactly. Because of this I'm facing the issue like

Exception in thread "Timer-0" com.google.gson.JsonSyntaxException: java.lang.IllegalStateException: Expected BEGIN_OBJECT but was STRING at line 1 column 12

My code looks like below,
import com.google.gson.Gson;
import com.google.gson.annotations.SerializedName;
import redis.clients.jedis.Jedis;

public class ExternalFeedSimulator {
private static Jedis jedis;
private static final String redisHost = "localhost";
private static final Integer redisPort = 6379;
private static Gson gson = new Gson();

public void start() {
try {
jedis = new Jedis(redisHost, redisPort);
getJSON();
long waitTime = 500;
bidaskratescheduleGenerator(bidaskrates, waitTime);
} catch (Exception e) { System.out.println(e);
}
}

public static String getJSON() {
try {
liveratesnew.clear(); ClientsRateRow[] craterows = gson.fromJson(jedis.get("WLallclientsrates"), ClientsRateRow[].class);
for (ClientsRateRow raterow : craterows) {
liveratesnew.put(raterow.client_com_id, raterow);
curclientrates.add(raterow);
}
RateRow[] cbaserates = gson.fromJson(jedis.get("WLBaseRates"), RateRow[].class);
for (RateRow raterow : cbaserates) {
bidaskrates.add(raterow);
}
} catch (IllegalStateException ex) {
ex.printStackTrace();
} finally {
jedis.close();
}
return null;

}

private void bidaskratescheduleGenerator(final ArrayList<RateRow> displayrates, long waitTime) {
dispatcher.schedule(new TimerTask() {
@Override
public void run() {
long nextWaitTime;
synchronized (displayrates) {
if (listener != null) {
for (RateRow curbidaskrates : displayrates) {
final HashMap<String, String> bidaskevent = new HashMap<String, String>();
bidaskevent.put("desc", curbidaskrates.getGold1_symbol());
bidaskevent.put("bid", curbidaskrates.getGold1_bid());
bidaskevent.put("ask", curbidaskrates.getGold1_ask());
bidaskevent.put("high", curbidaskrates.getGold1_high());
bidaskevent.put("low", curbidaskrates.getGold1_low());
bidaskevent.put("ltp", curbidaskrates.getGold1_ltp());
listener.onEvent(curbidaskrates.getGold1_symbol(), bidaskevent, false);
}
}
displayrates.clear();
nextWaitTime = 500;
}
getJSON();
bidaskratescheduleGenerator(bidaskrates, nextWaitTime);
}
}, waitTime);
}

}

In my php service every second will update the stock market rates into redis key as json string. In my java adapter for every 500 milliseconds i need to read and update to subscribed clients. Could you please help me on this how to do this in my adapter.

Giuseppe Corti

Hi,

The error message seems not pertaining to redis but to the json parser.
Please have a look at this https://stackoverflow.com/questions/28418662/expected-begin-object-but-was-string-at-line-1-column-1, maybe can help with your issue.

Regards,
Giuseppe

rvkvino

I have referred this link already,
My actual issue comes like this first time after that only I'm facing issue on json string. If I handle this issue the above json issue not comes.

redis.clients.jedis.exceptions.JedisConnectionException: java.net.SocketException: Connection reset by peer: socket write error
at redis.clients.jedis.Connection.flush(Connection.java:334)
at redis.clients.jedis.Connection.getBinaryBulkReply(Connection.java:257)
at redis.clients.jedis.Connection.getBulkReply(Connection.java:248)
at redis.clients.jedis.Jedis.get(Jedis.java:153)
at stocklist.feed_simulator.ExternalFeedSimulator.getJSON(ExternalFeedSimulator.java:78)
at stocklist.feed_simulator.ExternalFeedSimulator$1.run(ExternalFeedSimulator.java:128)
at java.util.TimerThread.mainLoop(Unknown Source)
at java.util.TimerThread.run(Unknown Source)
Caused by: java.net.SocketException: Connection reset by peer: socket write error
at java.net.SocketOutputStream.socketWrite0(Native Method)
at java.net.SocketOutputStream.socketWrite(Unknown Source)
at java.net.SocketOutputStream.write(Unknown Source)
at redis.clients.util.RedisOutputStream.flushBuffer(RedisOutputStream.java:52)
at redis.clients.util.RedisOutputStream.flush(RedisOutputStream.java:216)
at redis.clients.jedis.Connection.flush(Connection.java:331)
.

my json looks like this only

[
{
"com_id": "33",
"com_name": "GOLD BAR",
"selling_rate": "5001",
"buying_rate": "-",
"delivery": "03-07-2020",
"retail_rate": "-",
"com_weight": "1.000",
"com_order": "1",
"client": "lmxtrade",
"client_com_id": "lmxtrade_33",
"high_rate": "5002",
"low_rate": "4980"
},
{
"com_id": "36",
"com_name": "GOLD FT",
"selling_rate": "5001",
"buying_rate": "4800",
"delivery": "03-07-2020",
"retail_rate": "-",
"com_weight": "1.000",
"com_order": "2",
"client": "lmxtrade",
"client_com_id": "lmxtrade_36",
"high_rate": "5002",
"low_rate": "4980"
},
{
"com_id": "37",
"com_name": "GOLD RTGS",
"selling_rate": "4901",
"buying_rate": "-",
"delivery": "03-07-2020",
"retail_rate": "-",
"com_weight": "1.000",
"com_order": "3",
"client": "lmxtrade",
"client_com_id": "lmxtrade_37",
"high_rate": "4902",
"low_rate": "4880"
},
{
"com_id": "38",
"com_name": "SILVER",
"selling_rate": "49190",
"buying_rate": "48463",
"delivery": "03-07-2020",
"retail_rate": "-",
"com_weight": "1000.000",
"com_order": "4",
"client": "lmxtrade",
"client_com_id": "lmxtrade_38",
"high_rate": "49190",
"low_rate": "49190"
},
{
"com_id": "33",
"com_name": "GOLD CBE RTGS ",
"selling_rate": "5001",
"buying_rate": "4890",
"delivery": "07-07-2020",
"retail_rate": "-",
"com_weight": "1.000",
"com_order": "1",
"client": "kkvtrade",
"client_com_id": "kkvtrade_33",
"high_rate": "5002",
"low_rate": "4980"
},
{
"com_id": "36",
"com_name": "GOLD FT",
"selling_rate": "5001",
"buying_rate": "4900",
"delivery": "07-07-2020",
"retail_rate": "-",
"com_weight": "1.000",
"com_order": "2",
"client": "kkvtrade",
"client_com_id": "kkvtrade_36",
"high_rate": "5002",
"low_rate": "4980"
},
{
"com_id": "37",
"com_name": "GOLD RTGS",
"selling_rate": "4901",
"buying_rate": "5000",
"delivery": "07-07-2020",
"retail_rate": "-",
"com_weight": "1.000",
"com_order": "3",
"client": "kkvtrade",
"client_com_id": "kkvtrade_37",
"high_rate": "4902",
"low_rate": "4880"
},
{
"com_id": "38",
"com_name": "SILVER",
"selling_rate": "50369",
"buying_rate": "50354",
"delivery": "07-07-2020",
"retail_rate": "-",
"com_weight": "1000.000",
"com_order": "4",
"client": "kkvtrade",
"client_com_id": "kkvtrade_38",
"high_rate": "50400",
"low_rate": "50008"
}
]

This above json i'm parsing using the class,(Array of object)
ClientsRateRow[] craterows = gson.fromJson(jedis.get("WLallclientsrates"), ClientsRateRow[].class);

Giuseppe Corti

Have you tried to approach all redis operations in the getJSON method (open the connection, retrieve the json and close)?

rvkvino

Yes this helped me. I have open and close all the places wherever I have used Redis and then closed. Now working fine my adapter. My problem is solved in website. Now I need to know whether is there any LS client library is available for dart language. I'm developing app in Flutter, now I need to show market rates in app also which I done in website.

Giuseppe Corti

A flutter/dart client is in our roadmap, but not in the very short term.
But in the past we have suggested a workaround to those interested in the Flutter/Dart platform which consists of leverage our Android/iOS SDK and write a thin compatibility layer calling the Android/iOS Client API from Dart (see here for details).

As an extreme alternative if you are comfortable with the Dart language, you could directly implement the TLCP protocol at least for the functionality necessary for your app (https://www.lightstreamer.com/repo/distros/Lightstreamer_7_1_1_20200527.zip%23/Lightstreamer/DOCS-SDKs/sdk_client_generic/doc/TLCP%20Specifications.pdf).

Please let us know if you need any further clarifications.

Regards,
Giuseppe