9.2.7 Server stopping

classic Classic list List threaded Threaded
6 messages Options
Reply | Threaded
Open this post in threaded view
|

9.2.7 Server stopping

Rick Draper-2
Hi All,

 

I have a new Lasso instance installed on a CentOS 6.7 VM that is receiving
data from a number of IoT devices.  After a restart the instance runs
happily for about 2 hours and then stops - no errors, just red button in the
Instance manager.  If I restart the instance via Instance Manager, all is
happy again for another 2 hours, then it stops again.

 

The code that is running is essentially the same as the example at
http://lassoguide.com/operations/protocols-pipes.html?highlight=listen#net_t
cp->listen (with a database a SQL inline to insert the data received into a
table).  As I said above, it hums along happily and then just stops.

 

Any suggestions about debugging or similar experiences would be sincerely
appreciated.

 

Thanks and very best regards,

 

 

Rick


#############################################################

This message is sent to you because you are subscribed to
  the mailing list Lasso [hidden email]
Official list archives available at http://www.lassotalk.com
To unsubscribe, E-mail to: <[hidden email]>
Send administrative queries to  <[hidden email]>
Reply | Threaded
Open this post in threaded view
|

Re: 9.2.7 Server stopping

Bil Corry-3
Beyond the Lasso error log, you might look at OS level stats, such as
memory usage, open connections, file handles, etc.  Perhaps there is some
resource exhaustion going on - easy to do if you're not properly
terminating/freeing connections.


- Bil

On Sun, Jan 3, 2016 at 4:58 PM, Rick Draper <[hidden email]>
wrote:

> Hi All,
>
>
>
> I have a new Lasso instance installed on a CentOS 6.7 VM that is receiving
> data from a number of IoT devices.  After a restart the instance runs
> happily for about 2 hours and then stops - no errors, just red button in
> the
> Instance manager.  If I restart the instance via Instance Manager, all is
> happy again for another 2 hours, then it stops again.
>
>
>
> The code that is running is essentially the same as the example at
>
> http://lassoguide.com/operations/protocols-pipes.html?highlight=listen#net_t
> cp->listen (with a database a SQL inline to insert the data received into
> a
> table).  As I said above, it hums along happily and then just stops.
>
>
>
> Any suggestions about debugging or similar experiences would be sincerely
> appreciated.
>
>
>
> Thanks and very best regards,
>
>
>
>
>
> Rick
>
>
> #############################################################
>
> This message is sent to you because you are subscribed to
>   the mailing list Lasso [hidden email]
> Official list archives available at http://www.lassotalk.com
> To unsubscribe, E-mail to: <[hidden email]>
> Send administrative queries to  <[hidden email]>
>

#############################################################

This message is sent to you because you are subscribed to
  the mailing list Lasso [hidden email]
Official list archives available at http://www.lassotalk.com
To unsubscribe, E-mail to: <[hidden email]>
Send administrative queries to  <[hidden email]>
Reply | Threaded
Open this post in threaded view
|

Re: 9.2.7 Server stopping

Steffan A. Cline
When it quits, take a look at your open connections and see. You may have hit the limitation of how many open connections you can have. If you find that your Web app has too many open connections then look at the code and make sure that you were closing the TCP connection.

Thanks,
Steffan Cline
[hidden email]
602-793-0014

> On Jan 3, 2016, at 9:53 AM, Bil Corry <[hidden email]> wrote:
>
> Beyond the Lasso error log, you might look at OS level stats, such as
> memory usage, open connections, file handles, etc.  Perhaps there is some
> resource exhaustion going on - easy to do if you're not properly
> terminating/freeing connections.
>
>
> - Bil
>
> On Sun, Jan 3, 2016 at 4:58 PM, Rick Draper <[hidden email]>
> wrote:
>
>> Hi All,
>>
>>
>>
>> I have a new Lasso instance installed on a CentOS 6.7 VM that is receiving
>> data from a number of IoT devices.  After a restart the instance runs
>> happily for about 2 hours and then stops - no errors, just red button in
>> the
>> Instance manager.  If I restart the instance via Instance Manager, all is
>> happy again for another 2 hours, then it stops again.
>>
>>
>>
>> The code that is running is essentially the same as the example at
>>
>> http://lassoguide.com/operations/protocols-pipes.html?highlight=listen#net_t
>> cp->listen (with a database a SQL inline to insert the data received into
>> a
>> table).  As I said above, it hums along happily and then just stops.
>>
>>
>>
>> Any suggestions about debugging or similar experiences would be sincerely
>> appreciated.
>>
>>
>>
>> Thanks and very best regards,
>>
>>
>>
>>
>>
>> Rick
>>
>>
>> #############################################################
>>
>> This message is sent to you because you are subscribed to
>>  the mailing list Lasso [hidden email]
>> Official list archives available at http://www.lassotalk.com
>> To unsubscribe, E-mail to: <[hidden email]>
>> Send administrative queries to  <[hidden email]>
>
> #############################################################
>
> This message is sent to you because you are subscribed to
>  the mailing list Lasso [hidden email]
> Official list archives available at http://www.lassotalk.com
> To unsubscribe, E-mail to: <[hidden email]>
> Send administrative queries to  <[hidden email]>
>

#############################################################

This message is sent to you because you are subscribed to
  the mailing list Lasso [hidden email]
Official list archives available at http://www.lassotalk.com
To unsubscribe, E-mail to: <[hidden email]>
Send administrative queries to  <[hidden email]>
Reply | Threaded
Open this post in threaded view
|

RE: 9.2.7 Server stopping

Rick Draper-2
Thanks, Bil & Steffan.

Taking a look at some rapid snapshots of connections, things seem to be
closing.

# netstat -anp | grep :8120 | grep ESTABLISHED | wc -l
0
# netstat -anp | grep :8120 | grep ESTABLISHED | wc -l
2
# netstat -anp | grep :8120 | grep ESTABLISHED | wc -l
0

But maybe something on the other side is timing out from time to time - will
see what is happening next time it dies.

Thanks again for the pointers and very best regards,

Rick


-----Original Message-----
From: [hidden email]
[mailto:[hidden email]] On Behalf Of Steffan Cline
Sent: Monday, 4 January 2016 2:55 AM
To: [hidden email]
Subject: Re: 9.2.7 Server stopping

When it quits, take a look at your open connections and see. You may have
hit the limitation of how many open connections you can have. If you find
that your Web app has too many open connections then look at the code and
make sure that you were closing the TCP connection.

Thanks,
Steffan Cline
[hidden email]
602-793-0014

> On Jan 3, 2016, at 9:53 AM, Bil Corry <[hidden email]> wrote:
>
> Beyond the Lasso error log, you might look at OS level stats, such as
> memory usage, open connections, file handles, etc.  Perhaps there is
> some resource exhaustion going on - easy to do if you're not properly
> terminating/freeing connections.
>
>
> - Bil



#############################################################

This message is sent to you because you are subscribed to
  the mailing list Lasso [hidden email]
Official list archives available at http://www.lassotalk.com
To unsubscribe, E-mail to: <[hidden email]>
Send administrative queries to  <[hidden email]>
Reply | Threaded
Open this post in threaded view
|

Re: 9.2.7 Server stopping

Steffan A. Cline
Are those taken at the time that the process halts? Look to see how many of those are stuck in waiting.

Thanks,
Steffan Cline
[hidden email]
602-793-0014

> On Jan 3, 2016, at 10:11 AM, Rick Draper <[hidden email]> wrote:
>
> Thanks, Bil & Steffan.
>
> Taking a look at some rapid snapshots of connections, things seem to be
> closing.
>
> # netstat -anp | grep :8120 | grep ESTABLISHED | wc -l
> 0
> # netstat -anp | grep :8120 | grep ESTABLISHED | wc -l
> 2
> # netstat -anp | grep :8120 | grep ESTABLISHED | wc -l
> 0
>
> But maybe something on the other side is timing out from time to time - will
> see what is happening next time it dies.
>
> Thanks again for the pointers and very best regards,
>
> Rick
>
>
> -----Original Message-----
> From: [hidden email]
> [mailto:[hidden email]] On Behalf Of Steffan Cline
> Sent: Monday, 4 January 2016 2:55 AM
> To: [hidden email]
> Subject: Re: 9.2.7 Server stopping
>
> When it quits, take a look at your open connections and see. You may have
> hit the limitation of how many open connections you can have. If you find
> that your Web app has too many open connections then look at the code and
> make sure that you were closing the TCP connection.
>
> Thanks,
> Steffan Cline
> [hidden email]
> 602-793-0014
>
>> On Jan 3, 2016, at 9:53 AM, Bil Corry <[hidden email]> wrote:
>>
>> Beyond the Lasso error log, you might look at OS level stats, such as
>> memory usage, open connections, file handles, etc.  Perhaps there is
>> some resource exhaustion going on - easy to do if you're not properly
>> terminating/freeing connections.
>>
>>
>> - Bil
>
>
>
> #############################################################
>
> This message is sent to you because you are subscribed to
>  the mailing list Lasso [hidden email]
> Official list archives available at http://www.lassotalk.com
> To unsubscribe, E-mail to: <[hidden email]>
> Send administrative queries to  <[hidden email]>
>

#############################################################

This message is sent to you because you are subscribed to
  the mailing list Lasso [hidden email]
Official list archives available at http://www.lassotalk.com
To unsubscribe, E-mail to: <[hidden email]>
Send administrative queries to  <[hidden email]>
Reply | Threaded
Open this post in threaded view
|

RE: 9.2.7 Server stopping

Rick Draper-2
Hi Steffan,

No, they were just quick calls to randomly see how may connections were
open.

It actually hasn't missed a beat since the last restart (319 mins and
counting).  A little over 1,000 data points being logged per hour.

Very best regards,

Rick

-----Original Message-----
From: [hidden email]
[mailto:[hidden email]] On Behalf Of Steffan Cline
Sent: Monday, 4 January 2016 4:01 AM
To: [hidden email]
Subject: Re: 9.2.7 Server stopping

Are those taken at the time that the process halts? Look to see how many of
those are stuck in waiting.

Thanks,
Steffan Cline
[hidden email]
602-793-0014




#############################################################

This message is sent to you because you are subscribed to
  the mailing list Lasso [hidden email]
Official list archives available at http://www.lassotalk.com
To unsubscribe, E-mail to: <[hidden email]>
Send administrative queries to  <[hidden email]>