WebOS Internals - User contributions [en]

Meetups

2010-05-08T10:52:20Z

DrewPre:

People interested in meeting up should plop in their area and name so when we have critical mass it can be organized.

See also [http://predevcamp.org/ predevcamp.org].

== United States ==

=== Arizona ===
==== Phoenix, AZ ====
# EvanDotPro

=== California ===
==== Fresno ====
# A2NY

==== San Diego/Los Angeles ====
# JonVisc
# seigex (Inland Empire)
# hopspitfire
# hmagoo (desert)
#dpc (OC) [http://www.meetup.com/socal-webOS-Development-Group/ SoCal webOS Development Group]

==== San Francisco/Bay Area/SJ ====
Since Palm, Inc. is located in the Bay Area, Palm employees may join us for some tech talk or tips and tricks.

http://www.meetup.com/palm-webos/

# rulethirty (organizer)
# Robi
# jblebrun
# simplyflipflops
# pEEf
# bzhou (eno in IRC, optware manager)
# sarysa

=== Colorado ===
==== Denver ====
# destinal
# rcanzlovar
# raeb

=== Georgia ===
==== Atlanta ====
# DrewPre

=== Indiana ===
==== Northern Indiana ====
# jaf0

=== Kentucky ===
==== Cincinnati/NKY ====
# xandrake__
# foamcoretrash

=== Massachusetts ===
==== Boston ====
Please join us in the [http://www.webosboston.org/ WebOSBOSTON community - We have monthly meetings.]
# nebula (MIT campus area)
# jcrawford (Lynn MA area) http://josephcrawford.com/
# [[User:FreeTim|FreeTim]] (MIT campus area - in Kendall Sq.)
# djbclark Danny Clark <dclark@pobox.com> http://pobox.com/~dclark (MIT campus area)
# oc80z (MIT,Central Square for drinks)
# beingboston (Newton, Watertown area. Has T pass, can travel)
# trokair (Waltham area, can travel)
# r3compile
# asedeno (MIT)

=== Minnesota ===
==== Minneapolis/St. Paul ====
# xluryan
# helfire

=== Missouri ===
==== Kansas City ====
# xorg (attending [http://kansascity.predevcamp.org/attendees/ KC predev camp] - a couple dozen have signed up and growing)
# [[User:Clebio|Clebio]] 12:51, 24 August 2009 (UTC)
# [[User:Ikyo|Ikyo]]

=== Nevada ===
==== Las Vegas: [[wikipedia:DEF CON (convention)|Defcon]] 17 ====
# emkman
# pEEf
# destinal
# tharris-

=== New York ===
==== Albany ====
# JackieRipper

=== Oregon ===
==== Portland Area ====
# rck

=== Texas ===
==== Austin ====
# HattCzech
==== Dallas ====
# HebrewzHammer
# [[user:X1011|X1011]] ([[wikipedia:University of Texas at Dallas|UTD]], attended [http://dallas.predevcamp.org/ preDevCamp])

=== Washington ===
==== Seattle Area ====
# tictac
# BurntSky
# meshuga

=== Wisconsin ===
==== Madison ====
# [[user:Christian.wilcox|christianwilcox]]

Meetups

2010-05-08T10:51:41Z

DrewPre:

People interested in meeting up should plop in their area and name so when we have critical mass it can be organized.

See also [http://predevcamp.org/ predevcamp.org].

== United States ==

=== Arizona ===
==== Phoenix, AZ ====
# EvanDotPro

=== California ===
==== Fresno ====
# A2NY

==== San Diego/Los Angeles ====
# JonVisc
# seigex (Inland Empire)
# hopspitfire
# hmagoo (desert)
#dpc (OC) [http://www.meetup.com/socal-webOS-Development-Group/ SoCal webOS Development Group]

==== San Francisco/Bay Area/SJ ====
Since Palm, Inc. is located in the Bay Area, Palm employees may join us for some tech talk or tips and tricks.

http://www.meetup.com/palm-webos/

# rulethirty (organizer)
# Robi
# jblebrun
# simplyflipflops
# pEEf
# bzhou (eno in IRC, optware manager)
# sarysa

=== Colorado ===
==== Denver ====
# destinal
# rcanzlovar
# raeb

=== Georgia ===
=== Atlanta ===
# DrewPre

=== Indiana ===
==== Northern Indiana ====
# jaf0

=== Kentucky ===
==== Cincinnati/NKY ====
# xandrake__
# foamcoretrash

=== Massachusetts ===
==== Boston ====
Please join us in the [http://www.webosboston.org/ WebOSBOSTON community - We have monthly meetings.]
# nebula (MIT campus area)
# jcrawford (Lynn MA area) http://josephcrawford.com/
# [[User:FreeTim|FreeTim]] (MIT campus area - in Kendall Sq.)
# djbclark Danny Clark <dclark@pobox.com> http://pobox.com/~dclark (MIT campus area)
# oc80z (MIT,Central Square for drinks)
# beingboston (Newton, Watertown area. Has T pass, can travel)
# trokair (Waltham area, can travel)
# r3compile
# asedeno (MIT)

=== Minnesota ===
==== Minneapolis/St. Paul ====
# xluryan
# helfire

=== Missouri ===
==== Kansas City ====
# xorg (attending [http://kansascity.predevcamp.org/attendees/ KC predev camp] - a couple dozen have signed up and growing)
# [[User:Clebio|Clebio]] 12:51, 24 August 2009 (UTC)
# [[User:Ikyo|Ikyo]]

=== Nevada ===
==== Las Vegas: [[wikipedia:DEF CON (convention)|Defcon]] 17 ====
# emkman
# pEEf
# destinal
# tharris-

=== New York ===
==== Albany ====
# JackieRipper

=== Oregon ===
==== Portland Area ====
# rck

=== Texas ===
==== Austin ====
# HattCzech
==== Dallas ====
# HebrewzHammer
# [[user:X1011|X1011]] ([[wikipedia:University of Texas at Dallas|UTD]], attended [http://dallas.predevcamp.org/ preDevCamp])

=== Washington ===
==== Seattle Area ====
# tictac
# BurntSky
# meshuga

=== Wisconsin ===
==== Madison ====
# [[user:Christian.wilcox|christianwilcox]]

Lighttpd

2010-03-08T07:10:28Z

DrewPre:

= Configuring the Lighttpd web server =

== Preliminaries==
# Gain [[Portal:Accessing_Linux | access to Linux]] on your device.
# Setup the [[Next_steps | Optware Feed]].
# Open the root file system to read/write with rootfs_open.

== Install Lighttpd with PHP support ==

<pre><nowiki>ipkg-opt install lighttpd php-fcgi</nowiki></pre>

== Tweak settings ==

<pre><nowiki>vi /opt/etc/lighttpd/lighttpd.conf</nowiki></pre>
If you are going to run static HTML pages, there is no need to do this. If you want the ability to run PHP pages then this line must be uncommented:

<pre><nowiki> "mod_fastcgi", </nowiki></pre>

You may also want to adjust the port that the web server runs on. Sprint blocks port 80 and this package installs Lighttpd to run on port 8081 :

<pre><nowiki>
## bind to port (default: 80)
server.port = 8081
</nowiki></pre>

Start the web server:

<pre><nowiki>/opt/etc/init.d/S80lighttpd start</nowiki></pre>

== Add a startup script ==

I placed a file at /etc/event.d/optware-lighttpd so that the web server starts up after each reboot and the iptables firewall rules are executed to allow access to port 8080:

<pre><nowiki>
# don't start until the WebOS finishes it's normal boot
# that way no delay is added to the GUI startup
start on stopped finish
stop on runlevel [!2]

# Restart the lighttpd daemon if it exits/dies
respawn

exec /opt/sbin/lighttpd -f /opt/etc/lighttpd/lighttpd.conf

pre-start script
/usr/sbin/iptables -D INPUT -p tcp --dport 8081 -j ACCEPT || /bin/true
/usr/sbin/iptables -I INPUT -p tcp --dport 8081 -j ACCEPT
end script
</nowiki></pre>

Reboot the phone so that the firewall rules are executed:

<pre><nowiki>/sbin/reboot</nowiki></pre>

== Add files to the web directory: ==

The default home directory lives at:

<pre><nowiki>/opt/share/www/</nowiki></pre>

Sample gps.php file that will load your current location via Google maps:

<pre><nowiki>
<?php
$gps = `luna-send -n 1 palm://com.palm.location/getCurrentPosition {} 2>&1 | cut -d, -f4,5 | sed -r 's/[^-\.0-9,]//g'`;
?>
<html>
<iframe width="600" height="500" frameborder="0" scrolling="no" marginheight="0" marginwidth="0" src="http://maps.google.com/?ie=UTF8&q=<?php echo $gps ?>&z=16&ll=<?php echo $gps ?>&output=embed"></iframe><br /><small><a href="http://maps.google.com/?ie=UTF8&q=<?php echo $gps ?>&z=16&ll=<?php echo $gps ?>&source=embed" style="color:#0000FF;text-align:left">View Larger Map</a></small>
</html>
</nowiki></pre>

= Other Considerations =

== Dynamic DNS ==
# Install the ez-ipupdate package
# Configure ez-ipupdate to update a DDNS service any time the EVDO IP changes
# CNAME record of primary domain - I have a CNAME record pointed to my DDNS record so that I always have the most up-to-date IP of my phone

== Log files ==
# Need to keep an eye on the /opt/var/log/lighttpd/ log files and make sure they are rotated consistently

Lighttpd

2009-12-01T20:16:19Z

DrewPre:

= Configuring the Lighttpd web server =

== Preliminaries==
# Gain [[Portal:Accessing_Linux | access to Linux]] on your device.
# Setup the [[Next_steps | Optware Feed]].
# Open the root file system to read/write with rootfs_open.

==Edit==
Although this tutorial still works. It appears that Sprint has blocked http traffic over the external ip address on ppp0.[can someone confirm?] The tutorial still applies if you are accessing lighttpd using Wifi or USBnet.

== Install Lighttpd with PHP support ==

<pre><nowiki>ipkg-opt install lighttpd php-fcgi</nowiki></pre>

== Tweak settings ==

<pre><nowiki>vi /opt/etc/lighttpd/lighttpd.conf</nowiki></pre>
If you are going to run static HTML pages, there is no need to do this. If you want the ability to run PHP pages then this line must be uncommented:

<pre><nowiki> "mod_fastcgi", </nowiki></pre>

You may also want to adjust the port that the web server runs on. Sprint blocks port 80 and this package installs Lighttpd to run on port 8081 :

<pre><nowiki>
## bind to port (default: 80)
server.port = 8081
</nowiki></pre>

Start the web server:

<pre><nowiki>/opt/etc/init.d/S80lighttpd start</nowiki></pre>

== Add a startup script ==

I placed a file at /etc/event.d/optware-lighttpd so that the web server starts up after each reboot and the iptables firewall rules are executed to allow access to port 8080:

<pre><nowiki>
# don't start until the WebOS finishes it's normal boot
# that way no delay is added to the GUI startup
start on stopped finish
stop on runlevel [!2]

# Restart the lighttpd daemon if it exits/dies
respawn

exec /opt/sbin/lighttpd -f /opt/etc/lighttpd/lighttpd.conf

pre-start script
/usr/sbin/iptables -D INPUT -p tcp --dport 8081 -j ACCEPT || /bin/true
/usr/sbin/iptables -I INPUT -p tcp --dport 8081 -j ACCEPT
end script
</nowiki></pre>

Reboot the phone so that the firewall rules are executed:

<pre><nowiki>/sbin/reboot</nowiki></pre>

== Add files to the web directory: ==

The default home directory lives at:

<pre><nowiki>/opt/share/www/</nowiki></pre>

Sample gps.php file that will load your current location via Google maps:

<pre><nowiki>
<?php
$gps = `luna-send -n 1 palm://com.palm.location/getCurrentPosition {} 2>&1 | cut -d, -f4,5 | sed -r 's/[^-\.0-9,]//g'`;
?>
<html>
<iframe width="600" height="500" frameborder="0" scrolling="no" marginheight="0" marginwidth="0" src="http://maps.google.com/?ie=UTF8&q=<?php echo $gps ?>&z=16&ll=<?php echo $gps ?>&output=embed"></iframe><br /><small><a href="http://maps.google.com/?ie=UTF8&q=<?php echo $gps ?>&z=16&ll=<?php echo $gps ?>&source=embed" style="color:#0000FF;text-align:left">View Larger Map</a></small>
</html>
</nowiki></pre>

= Other Considerations =

== Dynamic DNS ==
# Install the ez-ipupdate package
# Configure ez-ipupdate to update a DDNS service any time the EVDO IP changes
# CNAME record of primary domain - I have a CNAME record pointed to my DDNS record so that I always have the most up-to-date IP of my phone

== Log files ==
# Need to keep an eye on the /opt/var/log/lighttpd/ log files and make sure they are rotated consistently

Application:BackupUtility

2009-11-24T13:38:40Z

DrewPre:

== Summary ==

The Backup Utility is an application that will allow you to backup and restore, Phone Data, Browser Data, and Applications. This application was developed as a supplement to the Palm Pre Backup utility that comes stock wtih all Palm Pres. It has the added benefit of providing you with control over what is backed up and how often. Additionally it provides you with control over your restoration process. It is not intended to be used to backup and restore across different versions of webOS. [Palm's Operating System] It is not a gaurd against Palm's upgrade process. It is a contingency plan for the Palm Backup. Nevertheless some test have revealed that you can backup from an older webOS version to a newer version; however, if you decide to do so, then do so at your own risk.

<b><font color=red>THIS APPLICATION MAY DESTROY DATA ON YOUR PHONE. DO NOT USE IT UNLESS YOU ARE WILLING TO RISK LOSING ALL DATA ON YOUR PHONE, AND POSSIBLY THE DATA IN YOUR PALM PROFILE TOO.</font></b><br>This is the very first public alpha release of a backup utility for webOS.<br>Please test it on the emulator only, and report your experiences on the PreCentral thread.<br>

See http://forums.precentral.net/showthread.php?p=2056899 until this page is filled

Application:BackupUtility

2009-11-24T13:37:19Z

DrewPre: /* Summary */

Application:BackupUtility

2009-11-24T13:21:18Z

DrewPre: /* Summary */

PalmDatabase.db3 File

2009-10-28T05:25:06Z

DrewPre: /* Perl Script */

The file '''/var/luna/data/dbdata/PalmDatabase.db3''' is an [http://www.sqlite.org/ sqlite] database file that appears to contain much of the personal data stored on the Pre. The information in this database, which has about 100 tables, includes contacts, events, account credentials, and call logs.

= Exploring PalmDatabase.db3=

A safe way to explore '''PalmDatabase.db3''' is to copy the file from the Pre to a computer where it can be examined with the [http://www.sqlite.org/sqlite.html sqlite3] command or an sqlite browser. A nice browser of this type of file is the Firefox Addon [http://code.google.com/p/sqlite-manager/ sqlite-manager]. With this browser, the structure of the database tables and their contents can be easily examined.

Some of the tables in PalmDatabase.db3 are:

* '''com_palm_pim_Contact''' – Has one entry per contact per profile. Includes pointers to the remote profiles.
* '''com_palm_pim_Person''' – Has one entry per contact Contains a field for the sort order of contacts displayed in the Contact application.
* '''com_palm_pim_FolderEntry''' – Contains messages, both SMS and Email. The GPS [[[Tracking]]] script looks for messages in this table.

= Modifying PalmDatabase.db3=

On my previous phone, I entered all contacts in the form "Lastname, Firstname" so that the phone would sort contacts by last name. The Pre internally saves names broken up by prefix, first name, middle name, last name and suffix and has the option to sort by first or last name. When the Sprint store transferred my contacts, the last name followed by a "," went into the first name field and the first name went into the last name field. To fix this, it should have been a simple matter of exporting the contacts from the phone, using an editor or script to swap the first and last name fields (and remove the ",") and then sending the contacts back to the phone. However, there seems to be no way at present to export or import contacts in the Palm Profile. (Except at a Sprint store).

Below is a python script, '''precontacts.py''' that implements this first/last name swap. This script uses the [*http://code.google.com/p/apsw/ APSW] sqlite3 wrapper. Similar scripts could be used with different sqlite wrappers such as [*http://pysqlite.org/ pysqlite] or with different scripting languages such as Perl. This script does not modify PalmDatabase.db3 directly, rather it writes a list of SQL commands that can be applied to the database. I suggest copying PalmDatabase.db3 to a host machine, generating the SQL commands, testing that those commands work, copying the list of SQL commands to the Pre, and then executing those commands against PalmDatabase.db3 (after making a backup of that file).

<pre><nowiki>
#!/usr/bin/env python

# Correct names imported from a non smart phone to the Pre where names on
# the old phone were entered in the form "Lastname, Firstname". Entries of
# this type had the first name put in the Pre's Lastname field and the
# last name and comma put in the first name field.
#
# Swap the first and last names in the Palm Pre contact database.
# Only do the swap when the name in the firstname field ends with a ",".
#
# The output of this script should be directed to a file. (say swap.sql) The
# database changes can then be done with "sqlite3 PalmDatabase.db3 < swap.sql".

import os, sys, time
import apsw

DBFILE="PalmDatabase.db3"

if os.path.exists(DBFILE):
connection=apsw.Connection(DBFILE)
cursor=connection.cursor()
else:
print "No database"

# Do name swap in com_palm_pim_Contact table

for first, middle, last, id in cursor.execute("select firstName, middleName, lastName, com_palm_pim_Person_id from com_palm_pim_Contact"):
if first:
if first[-1] == ",":
newlast = first[0:-1]
first = last
last = newlast
id=`id`[0:-1]
sql = "update com_palm_pim_Contact set lastName=\""+last+"\", firstName=\""+first+"\" where com_palm_pim_Person_id="+id+";"
print sql

# Do name swap in com_palm_pim_Person table

for first, middle, last, id, sortKey in cursor.execute("select firstName, middleName, lastName, id, sortKey from com_palm_pim_Person"):
if first:
if first[-1] == ",":
newlast = first[0:-1]
first = last
last = newlast
id=`id`[0:-1]
newsortKey = last+"\t"+first+"\t"
if middle:
newsortKey+=middle
newsortKey = newsortKey.upper()
sql = "update com_palm_pim_Person set lastName=\""+last+"\", firstName=\""+first+"\", sortKey=\""+newsortKey+"\" where id="+id+";"
print sql
</nowiki></pre>

=Exporting Contacts to Google CSV file=

Since we now have access to the database, it would be nice to export your contacts to Google Contacts so that they can be shared by other applications (phones that support Google Sync, Google Voice, Gmail, etc). Here's what you'll need:

# A copy of your PalmDatabase.db3
# sqlite3 executable binary
# Perl

Once you have that, modify the following two lines from the perl script below:

<pre><nowiki>
my $db = './PalmDatabase.db3';
my $sqlite = './sqlite3-3.6.16.bin';
</nowiki></pre>

They should point to the path of your sqlite3 binary and database. Once you've done that, just run your script and it should create 3 files:

# '''palm_pre_contacts.csv''' - CVS file that you can import into your Google Contacts
# '''select_contacts.sql''' - SQL script to show which contacts can be removed from your Palm Pre
# '''delete_contacts.sql''' - SQL script to delete the contacts from your Palm Pre

It would probably be a good idea to view the CSV file in a spreadsheet program to make sure the contacts look ok.

===Known Issues===
* delete_contacts.sql does not work. It throws a "no such collation sequence: LOCALIZED_SECONDARY". I haven't figured out to define this coallation sequence. For now, you will have to delete each entry manually. To avoid duplicates, you should do this before syncing with your Google account.
** (I have added a line to the script to load the palm extensions for sqlite3. If you copy the delete file over to the pre and run it on the device, it will work.) -[[user:Wsobel|Wsobel]]
* Only allows for 3 email entries and 3 phone entries maximum for each contact.
* Does not differentiate between different accounts. All contacts are grabbed.

==Perl Script==

<pre><nowiki>
#!/usr/bin/perl
use strict;

# copy of /var/luna/data/dbdata/PalmDatabase.db3
my $sqlite = './sqlite3-3.6.16.bin';
my $db = './PalmDatabase.db3';

my $contacts = {};
my @label = ('Home', 'Work', 'Other', 'Mobile');

my $header = q(Name,Given Name,Additional Name,Family Name,Yomi Name,Given Name Yomi,Additional Name Yomi,Family Name Yomi,Name Prefix,Name Suffix,Initials,Nickname,Short Name,Maiden Name,Birthday,Gender,Location,Billing Information,Directory Server,Mileage,Occupation,Hobby,Sensitivity,Priority,Subject,Notes,Group Membership,E-mail 1 - Type,E-mail 1 - Value,E-mail 2 - Type,E-mail 2 - Value,E-mail 3 - Type,E-mail 3 - Value,Phone 1 - Type,Phone 1 - Value,Phone 2 - Type,Phone 2 - Value,Phone 3 - Type,Phone 3 - Value);

my $sql = q{"SELECT com_palm_pim_Contact.firstName, com_palm_pim_Contact.lastName, com_palm_pim_ContactPoint.type, com_palm_pim_ContactPoint.value, com_palm_pim_ContactPoint.label, com_palm_pim_Contact.com_palm_pim_Person_id FROM com_palm_pim_Contact INNER JOIN com_palm_pim_ContactPoint ON com_palm_pim_Contact.id = com_palm_pim_ContactPoint.com_palm_pim_Contact_contactPts_id WHERE com_palm_pim_ContactPoint.type = 'EMAIL' OR com_palm_pim_ContactPoint.type = 'PHONE' ORDER BY com_palm_pim_Contact.firstName, com_palm_pim_Contact.lastName, com_palm_pim_ContactPoint.type ASC;"};

my $output = `$sqlite $db $sql`;

open(CSV, ">palm_pre_contacts.csv");
open(SQLDEL, ">delete_contacts.sql");
open(SQLSEL, ">select_contacts.sql");

print SQLDEL ".load /usr/lib/sqlite3_palm_extension.so\n";

print CSV "$header\n";

my @lines = split(/\n/, $output);

foreach my $line (@lines) {
#my @parts = split(/\|/, $line);
my ($first, $last, $type, $value, $label, $pid) = split(/\|/, $line);

if ($first && $first ne '') {
if (!($contacts->{$pid})) {
$contacts->{$pid} = {
'first' => $first,
'last' => $last,
'email' => [],
'phone' => []
}
}

if ($type eq 'EMAIL') {
push(@{$contacts->{$pid}->{email}}, {
label => $label[$label],
email => $value
});
}
elsif ($type eq 'PHONE') {
$value =~ s/[^\d]//g;
push(@{$contacts->{$pid}->{phone}}, {
label => $label[$label],
phone => $value
});
}

print SQLDEL "DELETE FROM com_palm_pim_Person WHERE id=$pid;\n";
print SQLSEL "SELECT id, firstName, lastName from com_palm_pim_Person WHERE id=$pid;\n";
}
}

while ( my ($pid, $value) = each(%$contacts) ) {
my @line = ();

$line[0] = $value->{'first'} . ' ' . $value->{'last'};
$line[1] = $value->{'first'};
$line[3] = $value->{'last'};
$line[26] = '* My Contacts';
$line[27] = $value->{'email'}->[0]->{label};
$line[28] = $value->{'email'}->[0]->{email};
$line[29] = $value->{'email'}->[1]->{label};
$line[30] = $value->{'email'}->[1]->{email};
$line[31] = $value->{'email'}->[2]->{label};
$line[32] = $value->{'email'}->[2]->{email};
$line[33] = $value->{'phone'}->[0]->{label};
$line[34] = $value->{'phone'}->[0]->{phone};
$line[35] = $value->{'phone'}->[1]->{label};
$line[36] = $value->{'phone'}->[1]->{phone};
$line[37] = $value->{'phone'}->[2]->{label};
$line[38] = $value->{'phone'}->[2]->{phone};

print CSV join(',', @line) . "\n";
}

close(CSV);
close(SQLDEL);
close(SQLSEL);
</nowiki></pre>