Minimal Solaris

Bring back lx brand?

2011-06-30T08:14:00.000-07:00

It is hard to say why the BrandZ code was removed from the OpenSolaris. However this can be corrected. With small fixes I've now got CentOS running in a zone on Illumos:


The Illumos Project SunOS 5.11 illumos-gate June 2011
root@indy:~# zoneadm -z centos boot; zlogin -C centos
[Connected to zone 'centos' console]
 Welcome to CentOS
Press 'I' to enter interactive startup.
Configuring kernel parameters:  [  OK  ]
Setting hostname centos:  [  OK  ]
Checking root filesystem: [  OK  ]
Activating swap partitions:  [  OK  ]
...  
CentOS release 3.7 (Final)
Kernel 2.4.21 on an i686

centos login: root
Password: 
Welcome to your shiny new Linux zone.

        - The root password is 'root'.  Please change it immediately.
    
  - To enable networking goodness, see /etc/sysconfig/network.example.
 
  - This message is in /etc/motd.  Feel free to change it.

For anything more complicated, see:
  http://opensolaris.org/os/community/brandz/
  
You have mail.
-bash-2.05b# cat /proc/cpuinfo 
processor         : 3
vendor_id         : GenuineIntel
cpu family       : 6
model          : 30
model name    : Intel(r) Core(tm) i7 CPU       Q 720  @ 1.60GHz
stepping                 : 5
cpu MHz          : 1596.146
cache size       : 0 KB
fdiv_bug            : no
hlt_bug                  : no
f00f_bug         : no
coma_bug         : no
fpu                  : yes
fpu_exception : yes
cpuid level         : 11
flags        : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm pni monitor ds_cpl est tm2 cx16 xtpr
...

Sample client for istatd

2010-07-13T01:26:00.000-07:00

IPhone owners can use a great app for servers monitoring - istat. On the server you must install the istatd daemon. More information can be read here: http://blogs.sun.com/karim/entry/monitoring_opensolaris_from_an_itouch.
Here an example of a console client for istatd, you can use this data for plotting, etc:
$ gcc -o istatd_client istatd_client.c -lsocket -lnsl
$ ./istatd_client
Usage: istatd_client <server_ip> <server_port> <server_code>
Example output from OpenSolaris server:


/istatd_client XX.XXX.XX.X 5109 12345
Connected to XX.XXX.XX.X on port 5109

<?xml version="1.0" encoding="UTF-8"?><isr ready="1"></isr>
<?xml version="1.0" encoding="UTF-8"?><isr pl="2" ath="0" ss="6" c="7788968" n="7788967"></isr>
<?xml version="1.0" encoding="UTF-8"?><isr ds="8" ts="8" fs="8" rid="1"><CPU><c id="-1" u="1" s="3" n="0"></c></CPU><NET if="1"><n id="-1" d="12545352948" u="276928235931" t="1279010768"></n></NET><MEM w="1568" a="326" i="0" f="190" t="2086" su="51" st="1043" pi="79363" po="17312"></MEM><LOAD one="0.230469" fv="0.238281" ff="0.234375"></LOAD><UPT u="7788967"></UPT><DISKS><d n="/" uuid="rpool/ROOT/opensolaris-1" f="43352" p="21.1999"></d><d n="/hosting" uuid="hosting" f="134024" p="4.63293"></d></DISKS></isr>
...

Looking through istatd code, you can easily recognize what's mean all these variables (for example "u" in <CPU> denotes cpu_user usage).

Osstat 0.3

2010-06-16T05:09:00.000-07:00

Osstat applet now reaches version 0.3 - minor fixes, new graphs and some features.

Feel free to optimize code or change parts to use better ways.
Download here.

Using ddu scripts

2010-04-15T07:01:00.000-07:00

Have you ever looked in the "/usr/ddu" directory? Console-lovers can use some of these scripts and get the almost same output as from the "ddu" graphic utility. For example, I changed the probe.sh script a bit and now I can get ddu-like info from console:


(root@elvis)# ./ddu.sh
AUDIO
   Intel Corporation 82801DB/DBL/DBM (ICH4/ICH4-L/ICH4-M) AC'97 Audio Controller : audio810
CPU
   1 X Intel(R) Celeron(R) CPU 2.26GHz, 1-core : ---
CD_DVD
   Intel Corporation 82801DB (ICH4) IDE Controller : pci-ide
   Optiarc DVD RW AD-5200A : 0
MEMORY
    1G (512M + 512M) ;  2G maximum : ---
NETWORK
   Realtek Semiconductor Co., Ltd. RTL-8139/8139C/8139C+ : rtls
STORAGE
   Intel Corporation 82801DB (ICH4) IDE Controller : pci-ide
USB
   Intel Corporation 82801DB/DBL/DBM (ICH4/ICH4-L/ICH4-M) USB UHCI Controller #1 : uhci
   Intel Corporation 82801DB/DBL/DBM (ICH4/ICH4-L/ICH4-M) USB UHCI Controller #2 : uhci
   Intel Corporation 82801DB/DBL/DBM (ICH4/ICH4-L/ICH4-M) USB UHCI Controller #3 : uhci
   Intel Corporation 82801DB/DBM (ICH4/ICH4-M) USB2 EHCI Controller : ehci
VIDEO
   Intel Corporation 82845G/GL[Brookdale-G]/GE Chipset Integrated Graphics Device : i915
OTHERS
   PC standard floppy disk controller : fdc
   16550A-compatible COM port : asy
   ECP printer port : ecpp
   PS/2 Port for PS/2-style Mice : mouse8042
   System keyboard : kb8042
(root@elvis)#

Boot chart for MilaX 0.5

2010-02-19T04:21:00.000-08:00

Conky 1.7.2 on OpenSolaris

2009-11-24T23:53:00.000-08:00

I've tried to compile the last Conky 1.7.2 version with Lua Cairo bindings on OpenSolaris and should say it impress me. It was necessary to tinker with code a little but I liked the result.

I hope to prepare clean patch soon.

Installing OpenSolaris on a Sparc using LiveCD

2009-11-10T02:02:00.000-08:00

I've written a sample installation script for Sparc snv125 LiveCD. Taking as basis my "zfsinstall" script for MilaX Sparc LiveCD and improving some hacks for BE, I've now a working OpenSolaris system on my old Ultra 60, with possibility for next upgrading.
Required steps:
1. Boot from LiveCD. (After booting I disabled some services like AI,LDOM which are not necessary on my Ultra).
2. Configure network (plumb interface and enable ssh).
3. Download and run zfsinstall_sparc script (i.e. ./zfsinstall_sparc c4t1d0s0)
4. Reboot.

Sample output:


root@opensolaris:/jack# ./zfsinstall c4t1d0s0
Test TI started in real mode...
Target type specified: BE
BE target prepared successfully
BE target created successfully
Starting to copy data from UFS root to /zfsroot - this may take some time.
Updating vfstab
Updating boot-archive
updating /zfsroot//platform/sun4u/boot_archive
Installing zfs bootblk on /dev/rdsk/c4t1d0s0
###################################################

OpenSolaris now installed.

root@opensolaris:/jack# beadm umount opensolaris
root@opensolaris:/jack# reboot -- disk1
...
Sun Ultra 60 UPA/PCI (UltraSPARC-II 360MHz), Keyboard Present
OpenBoot 3.17, 512 MB memory installed, Serial #
Ethernet address 8:0:20:b8:a3:b9, Host ID: 80b8a3b9

Rebooting with command: boot disk1
Boot device: /pci@1f,4000/scsi@3/disk@1,0  File and args: 
SunOS Release 5.11 Version snv_125 64-bit
Copyright 1983-2009 Sun Microsystems, Inc.  All rights reserved.
Use is subject to license terms.
WARNING: consconfig: cannot find driver for screen device /SUNW,ffb@1e,0
Can't find driver for console framebuffer
Hostname: opensolaris
Configuring devices.
Loading smf(5) service descriptions: 137/137
Reading ZFS config: done.
Mounting ZFS filesystems: (6/6) 

opensolaris console login:
...
# beadm list
BE           Active Mountpoint Space   Policy Created
--           ------ ---------- ------- ------ -------
opensolaris  NR     /          580.69M static 2009-11-10 01:45
#

P.S. Now I've already updated the system to snv126.

OpenSolaris Sparc snv125 LiveCD

2009-11-05T04:12:00.000-08:00

Following numerous requests from users I've prepared Sparc LiveCD based on osol-1002-125-ai-sparc.iso (see my previous post). Please remember that this iso is UNOFFICIAL version, I've created it only for my tests. With this iso you can test OpenSolaris on your hardware, AI tools or you can install system from this LiveCD manually, using steps from my old posts (i.e. you need to create zpool, copy all LiveCD contents to rootfs, disable live-media services, change vfstab and etc).
Temporarily iso is here.

How to make a sparc Live CD from AI

2009-09-16T04:07:00.000-07:00

That's what I did to get the LiveCD from last AI iso.
On sparc machine:


# mkdir -p /opt/livecd/s0.
# mount -F hsfs `lofiadm -a osol-1002-122-ai-sparc.iso` /mnt

I copied all iso's content to s0 and then I've unpacked /opt/livecd/s0/boot/boot_archive with root_archive to /opt/livecd/tmp.
Next:


# cd /opt/livecd/tmp
# echo snv122 > .volumeid
# mv  .autoinstall .livecd

I've also removed last block about keyboard configuration and gdm in /lib/svc/method/live-fs-root.
Next I've created lofi directory in /opt/livecd/tmp/dev and symlink in this directory to ../../devices/pseudo/lofi@0:1 (this is required for mounting solaris.zlib).
I took hsfs.bootblock from SXCE DVD and put it in boot directory.


# cd /opt/livecd/s0/boot/ 
# root_archive pack boot_archive /opt/livecd/tmp

Script root_archive required small hack for boot-archive size - I've added line "size=130000" before "/usr/sbin/mkfile ${size}k "$TMR".
Next I've created symlinks for boot_archive in /opt/livecd/s0/platform/sun4v and /opt/livecd/s0/platform/sun4u
Now iso:


# cd /opt/livecd/ 
# mkisofs -G s0/boot/hsfs.bootblock -B ... -l -ldots -R -N -D -V snv122 -o /opt/sparc_snv122.iso s0/

Live CD boots on my old Ultra 60 (you can see some warnings and services errors but that's another story):

Minimal OpenSolaris SPARC install

2009-07-14T05:41:00.000-07:00

Using previous instructions I've successfully installed opensolaris 2009.06 on my TestFarm (thanks, Jim) T2000 from existing Nevada b98.
Steps are identical: my machine have 4 disks, so I've prepared third disk (c0t2d0) for installation (I take 4gb):


Part      Tag    Flag     Cylinders         Size            Blocks
  0       root    wm       0 -   824        4.00GB    (825/0/0)     8395200
  1 unassigned    wm       0                0         (0/0/0)             0
  2     backup    wu       0 - 14086       68.35GB    (14087/0/0) 143349312
  3 unassigned    wm       0                0         (0/0/0)             0
  4 unassigned    wm       0                0         (0/0/0)             0
  5 unassigned    wm       0                0         (0/0/0)             0
  6 unassigned    wm       0                0         (0/0/0)             0
  7 unassigned    wm       0                0         (0/0/0)             0

Next steps (it's fast):


zpool create opensolaris c0t2d0s0
zfs create opensolaris/rootfs
zfs set compression=on opensolaris/rootfs
zfs set mountpoint=legacy opensolaris/rootfs
mkdir /zfsroot
mount -f zfs opensolaris/rootfs /zfsroot

Here's minimal list of packages for my T2000 (sun4v):


SUNWcsd
SUNWcs
SUNWcsl
SUNWcakr
SUNWcar
SUNWcfcl
SUNWckr
SUNWcnetr
SUNWcurl
SUNWefc
SUNWerid
SUNWesu
SUNWfctl
SUNWpd
SUNWfchba
SUNWfruid
SUNWgnu-idn
SUNWgss
SUNWgssc
SUNWinstall-libs
SUNWipf
SUNWipkg
SUNWkey
SUNWkvm
SUNWldom
SUNWlexpt
SUNWlibC
SUNWlibms
SUNWlibsasl
SUNWloc
SUNWlxml
SUNWmd
SUNWnfsc
SUNWnfsckr
SUNWopenssl
SUNWperl584core
SUNWpicl
SUNWpool
SUNWpr
SUNWsmapi
SUNWrmodu
SUNWssh
SUNWsshcu
SUNWsshd
SUNWPython
SUNWpython-pyopenssl
SUNWTcl
SUNWTk
SUNWadmap
SUNWadmlib-sysid
SUNWadmr
SUNWbash
SUNWbip
SUNWbzip
SUNWtecla
SUNWtls
SUNWtoo
SUNWwbsup
SUNWxwrtl
SUNWzfs
SUNWzfskr
SUNWzlib
SUNWzone
SUNWintgige
entire

I already have pkg built and installed from sources on my Nevada. Now network installation:


pkg image-create -F -f -a opensolaris.org=http://pkg.opensolaris.org /zfsroot

cd /zfsroot

for pkg in `cat pkg.lst`; do  pkg install --no-refresh --no-index $pkg; done

echo "etc/zfs/zpool.cache" >> /zfsroot/boot/solaris/filelist.ramdisk

zpool set bootfs=opensolaris/rootfs opensolaris

echo "opensolaris/rootfs   -  /   zfs  -  no   -"  >> /zfsroot/etc/vfstab

mkdir -p /opensolaris/platform/sun4v

cp /zfsroot/platform/sun4v/bootlst /opensolaris/platform/sun4v/

cp /zfsroot/lib/svc/seed/global.db /zfsroot/etc/svc/repository.db      

devfsadm -R /zfsroot

bootadm update-archive -R /zfsroot

installboot -F zfs /platform/sun4v/lib/fs/zfs/bootblk /dev/rdsk/c0t2d0s0

Booting:


ok boot disk2
...
Sun Fire T200, No Keyboard
Copyright 2008 Sun Microsystems, Inc.  All rights reserved.
OpenBoot 4.28.9, 16256 MB memory available
...
Boot device: /pci@780/pci@0/pci@9/scsi@0/disk@2  File and args: 
SunOS Release 5.11 Version snv_111b 64-bit
Copyright 1983-2009 Sun Microsystems, Inc.  All rights reserved.
Use is subject to license terms.
Hostname: unknown
Configuring devices.
Loading smf(5) service descriptions: 84/84
Reading ZFS config: done.
Mounting ZFS filesystems: (2/2)

unknown console login: root
Password: 
Sun Microsystems Inc.   SunOS 5.11      snv_111b        November 2008
root@unknown:~# df -h
Filesystem             size   used  avail capacity  Mounted on
opensolaris/rootfs     3.9G   630M   3.3G    16%    /
/devices                 0K     0K     0K     0%    /devices
/dev                     0K     0K     0K     0%    /dev
ctfs                     0K     0K     0K     0%    /system/contract
proc                     0K     0K     0K     0%    /proc
mnttab                   0K     0K     0K     0%    /etc/mnttab
swap                    12G   176K    12G     1%    /etc/svc/volatile
objfs                    0K     0K     0K     0%    /system/object
sharefs                  0K     0K     0K     0%    /etc/dfs/sharetab
fd                       0K     0K     0K     0%    /dev/fd
swap                    12G     0K    12G     0%    /tmp
swap                    12G    16K    12G     1%    /var/run
opensolaris            3.9G    60K   3.3G     1%    /opensolaris

This install take only 630 mb. Now I can adjust my network settings and install additional packages.

Get detailed disk info with Caiman libraries

2009-07-09T00:22:00.000-07:00

Using Caiman libraries you can write small programs which can be very useful in sysadmin's daily work or can help making your own installer. For example, using libtd (Target Discovery) library you can get info about system disks and partitions very fast. Here's an example of using libtd test program (test_td):


# ./test_td -d
Disk discovery
Total number of disks: 3
---------------------------------
 num |    name|  ctype|size [MB]|
---------------------------------
   1 |  c2t0d0|    usb|      976|
   2 |    c0d0|    ata|    76350|
   3 |    c1d0|    ata|    38166|
---------------------------------

# ./test_td -p all
Partition discovery for all disks
-------------------------------------
 num |        name| active| ID| lswp|
-------------------------------------
   1 |    c2t0d0p1|    Yes| BF|   No|
   2 |      c0d0p1|    Yes| BF|   No|
   3 |      c1d0p3|     No| 83|   No|
   4 |      c1d0p2|    Yes| 83|   No|
   5 |      c1d0p1|     No| 82|  Yes|
-------------------------------------

Now verbose output:


# ./test_td -d -v
Disk discovery
Total number of disks: 3
-------------------------------------------------------------------------------
 num |    name|    vendor|  ctype| mtype| rem| lbl| bsize|#of blocks|size [MB]|
-------------------------------------------------------------------------------
   1 |  c2t0d0|     Multi|    usb| FIXED| Yes|  VF|   512|   1999872|      976|
   2 |    c0d0|   unknown|    ata| FIXED|  No|  VF|   512| 156364992|    76350|
   3 |    c1d0|   unknown|    ata| FIXED|  No|  VF|   512|  78164352|    38166|
-------------------------------------------------------------------------------

# ./test_td -p all -v
Partition discovery for all disks
---------------------------------------------------------------------
 num |        name| active| ID| lswp| 1st block|#of blocks|size [MB]|
---------------------------------------------------------------------
   1 |    c2t0d0p1|    Yes| BF|   No|      2048|   1996800|      975|
   2 |      c0d0p1|    Yes| BF|   No|     16065| 156344580|    76340|
   3 |      c1d0p3|     No| 83|   No|  20547135|  57609090|    28129|
   4 |      c1d0p2|    Yes| 83|   No|   1012095|  19535040|     9538|
   5 |      c1d0p1|     No| 82|  Yes|        63|   1012032|      494|
---------------------------------------------------------------------

LiveUSB for Asus Eee PC

2009-06-22T05:34:00.000-07:00

I've tried to prepare MilaX LiveUSB for Asus Eee PC a year ago. Today WiFi and Ethernet drivers work well for my 900.

Busybox on OpenSolaris ARM

2009-06-10T04:32:00.000-07:00

After some steps I've got busybox running on OpenSolaris ARM under Qemu:

And here's the output I get from booting in debug mode (look how modstatic loads modules).

First OpenSolaris ARM release

2009-06-09T01:18:00.000-07:00

Great news from OpenSolaris ARM Port project: first OS release for ARM platform is now available. This release support NEC Electronics's NaviEngine 1 (NE1) and has some interesting features: genunix, unix and required device drivers are statically linked at building time as vmunix to save the startup time, zfs is modified to save the runtime memory.

So I hope that after some time we'll see OpenSolaris powered PDA.

Minimizing SunStudio

2009-06-07T23:28:00.000-07:00

SunStudio Express uses ~900 mb on my Nevada. But for building usual C app I need only small part of SS. For example I used only these files for building imlib2 (I tried various flags):


# cd /opt/SUNWspro; find .
.
./lib
./lib/crt1x.o
./lib/crti.o
./lib/sys
./lib/sys/libyabe.so
./lib/sys/lib_I_quad.so
./lib/sys/libsunir.so
./lib/sys/liblni.so.1
./lib/libdwarf.so
./lib/crt1.o
./lib/libmopt.a
./lib/libdwarf.so.1
./lib/lib_I_dbg_gen.so.1
./lib/values-xa.o
./lib/libm.il
./lib/lib_I_dbg_gen.so
./lib/crtn.o
./bin
./bin/iropt
./bin/fbe
./bin/cc
./bin/ir2hf
./bin/ube
./bin/acomp

# du -hs
  19M .

Of course you also need headers for successful compilation, but referring to cc if space is important factor for you - 19 is not 900, right?

Minimal OpenSolaris network install script

2009-04-26T22:27:00.000-07:00

While preparing new version of zfsinstall, I've written sample version for minimal OpenSolaris installation over network. This script also includes disk partitioning. If complete installation is needed just replace pkg list with:


entire
SUNWcsd
SUNWcs

Try it if you've problems with graphics on old laptops and you can't run GUI installer.
You can find osinstaller script in MilaX mercurial repository on OpenSolaris.org.

Busybox on OpenSolaris

2009-04-14T04:57:00.001-07:00

I hacked busybox and now it's working on my Solaris machine. This is not very fresh version (1.2.0) because all last releases become more Linux-specific. I've removed some applets and added "df","init","mount","umount","ps" from Solaris. Network applets like "ifconfig" are currently not implemented. For embedded Solaris we need native "ifconfig" with "plumb" function.


~$ uname -a
SunOS sysadm 5.11 snv_110 i86pc i386 i86pc
~$ ./busybox
BusyBox v1.2.0 (2009.04.20-10:06+0000) multi-call binary

Usage: busybox [function] [arguments]...
   or: [function] [arguments]...

 BusyBox is a multi-call binary that combines many common Unix
 utilities into a single executable.  Most people will create a
 link to busybox for each function they wish to use and BusyBox
 will act like whatever it was invoked as!

Currently defined functions:
 [, [[, awk, bunzip2, busybox, bzcat, cat, chgrp, chmod, chown, chroot, clear, cp, cpio, cut, date, dd, df, du, echo, ed, egrep, env, false,
 fgrep, find, grep, gunzip, gzip, halt, head, hostid, hostname, hush, id, init, kill, less, ls, md5sum, mkdir, mknod, mount, mv, nc, nslookup,
 poweroff, printf, ps, pwd, reboot, rm, sed, sh, sleep, sort, tar, tee, telnet, test, touch, tr, true, tty, umount, uname, unzip, vi, wc, whoami,
 xargs, yes, zcat

Drawing CPU part of boot chart

2009-02-05T23:33:00.000-08:00

I'm using kstat for drawing CPU part of boot chart (see my previous posts). I need cpu values for "user","nice","system","idle","iowait" in such order (sample output):


cpu 8 0 141 313 230 0 0

I've written the small kstat utility and added its call in a bootchartd script (utility writes /var/log/bootchart/proc_stat.log):


#include <kstat.h>
#include <sys/sysinfo.h>
#include <stdio.h>
#include <string.h>

static kstat_ctl_t *kc;
static kstat_t *ksp;

static unsigned int cpu_user, cpu_system, cpu_nice, cpu_idle, cpu_iowait;

int main(int argc, char **argv) {
cpu_stat_t *cpu_stat;

kc = kstat_open();

if (kc != NULL) {

ksp = kstat_lookup(kc, "cpu_stat", 0, "cpu_stat0");
if (ksp != NULL && ksp->ks_type == KSTAT_TYPE_RAW)
{
if (kstat_read(kc, ksp, NULL) != -1 &&  
ksp->ks_data_size == sizeof(cpu_stat_t))
{
  cpu_stat = (cpu_stat_t *)ksp->ks_data;
  cpu_user=cpu_stat->cpu_sysinfo.cpu[CPU_USER];
  cpu_nice=cpu_stat->cpu_sysinfo.cpu[CPU_WAIT];
  cpu_system = cpu_stat->cpu_sysinfo.cpu[CPU_KERNEL] ;
  cpu_iowait=cpu_stat->cpu_syswait.iowait;
  cpu_idle=cpu_stat->cpu_sysinfo.cpu[CPU_IDLE];

 printf("cpu  %d %d %d %d %d 0 0\n",
 cpu_user,cpu_nice,cpu_system,cpu_idle,cpu_iowait);
        }
    }
  }
}

Here boot chart for snv_105:

Reducing Boot Time

2009-02-03T02:55:00.000-08:00

In the last MilaX release (0.3.3) I've tried to reduce boot time from kernel startup to desktop environment up and running. I left only necessary SMF-services for LiveCD and changed startup sequence. The main idea - network services and compressed usr filesystem mounting can start after X server starting.
Here the services list after full booting:


STATE          STIME    FMRI
online         19:49:10 svc:/system/svc/restarter:default
online         19:49:13 svc:/network/datalink-management:default
online         19:49:14 svc:/system/filesystem/usr:default
online         19:49:14 svc:/system/filesystem/root:default
online         19:49:14 svc:/system/utmp:default
online         19:49:21 svc:/system/device/local:default
online         19:49:21 svc:/milestone/devices:default
online         19:49:22 svc:/system/filesystem/minimal:default
online         19:49:22 svc:/system/manifest-import:default
online         19:49:23 svc:/system/rmtmpfiles:default
online         19:49:23 svc:/system/filesystem/local:default
online         19:49:23 svc:/application/xserver:default
online         19:49:24 svc:/system/console-login:default
online         19:49:49 svc:/network/initial:default
online         19:49:57 svc:/network/loopback:default
online         19:49:58 svc:/system/system-log:default
online         19:50:01 svc:/system/cryptosvc:default
online         19:50:04 svc:/system/dbus:default
online         19:50:04 svc:/network/physical:default
online         19:50:06 svc:/system/identity:node
online         19:50:14 svc:/network/rpc/bind:default
online         19:50:18 svc:/system/hal:default
online         19:50:20 svc:/network/inetd:default
online         19:50:25 svc:/network/rpc/gss:default

Bootchart picture offers some details:

Certainly USB-booting yields the best results: for example on my DELL notebook I've booted MilaX from usb stick for 27 seconds. I've not included Moinak's code for compressed ramdisk support in this release, but I hope that I'll make it further.

Getting maximum info at booting

2009-01-20T04:16:00.000-08:00

As I already written above, it's very useful to know all the current processes in boot time. You can get more interesting information. If we look at the contents of "live-devices-local" script in OpenSolaris LiveCD we'll see possibility to use iosnoop with output in logfile (iosnoop uses DTrace to monitor disk events in real time):


...
# Turn on I/O tracing if requested and possible
trace=`prtconf -v /devices|sed -n '/trace/{;n;p;}'|cut -f 2 -d\'`
if [ "$trace" = "on" ]; then
   if [ -n "$mntpt" ]; then
       outputfile="${mntpt}/traceout"
       echo "Enabling I/O Tracing ..." > /dev/console
       /opt/DTT/Bin/iosnoop -Deg > "$outputfile" 2> /dev/console &
       # Wait for iosnoop to actually initialize
       sleep 10
   else
       echo "Unable to enable I/O Tracing" > /dev/console
       echo "Must have a mountable Solaris root slice on harddisk" > /dev/console
       echo "to hold trace output" > /dev/console
   fi
fi
...

Here's another fast way without using "live-devices-local" script: boot with "-m milestone=none" and next (I'm using opensnoop):


mount -F tmpfs -o size=32m swap /var/log
/opt/DTT/Bin/opensnoop -eg > /var/log/opensnoop.log &
svcadm milestone all

Except iosnoop a lot of helpful information can be gathered using other DTrace scripts (opensnoop,errinfo) with various arguments. For example, the opensnoop script considerably simplifies search of all files necessary for booting without errors.

Boot chart with help of DTrace and Python

2009-01-12T02:46:00.000-08:00

Anonymous tracing allows to receive more interesting information about Solaris booting process. I use a simple D-script (boot.d):


#!/usr/sbin/dtrace -Cs
#pragma D option quiet
/* I need process pid, his forks and life time */ 
proc:::create
{
 printf("<fork ppid=%d cpid=%d execname=%s time=%d />\n",
         pid,args[0]->pr_pid,execname,`lbolt*10/ `hz);
}

proc:::exec-success
{
 printf("<process pid=%d execname=%s time=%d />\n",
         pid,execname,`lbolt*10/ `hz);
}

proc:::exit
{

 printf("<end pid=%d execname=%s time=%d />\n", 
         pid, execname,`lbolt*10/ `hz);
}

Then I enable anonymous tracing:


dtrace -AFs /boot/boot.d
reboot

After reboot I write a logfile and disable anonymous tracing:


dtrace -ae -o bootlog
dtrace -A

Logfile looks like this:


CPU FUNCTION                                                                                                                                                 
  0 | exec_common:exec-success <process pid=1 execname=init time=63 />                                                                        
  0 | cfork:create             <fork ppid=1 cpid=4 execname=init time=66 />                                                                   
  0 | exec_common:exec-success <process pid=4 execname=ksh93 time=67 />                                                                       
  0 | exec_common:exec-success <process pid=4 execname=autopush time=87 />                                                                    
  0 | proc_exit:exit           <end pid=4 execname=autopush time=92 />                                                                        
  0 | cfork:create             <fork ppid=1 cpid=5 execname=init time=92 />                                                                   
  0 | exec_common:exec-success <process pid=5 execname=ksh93 time=92 />                                                                       
  0 | exec_common:exec-success <process pid=5 execname=soconfig time=94 /> 
...

Now by help of a python it's possible to parse logfile. I've written a small script bootchart.py for parsing and chart construction. It would be great to trace and draw the cpu part but this is not implemented yet.
To create boot chart you need run bootchart.py with logfile as an argument:


bootchart.py bootlog

This is a boot chart example for OpenSolaris 2008.11:

Boot charts for 2008.11 and snv101

2008-12-24T03:41:00.000-08:00

Bootchart is a great tool for performance analysis and visualization of the Linux boot process. Eric Schrock and Dan Price worked on a Bootchart port using DTrace but I can't find any recipes on their blogs.
I've viewed bootchart source files for two days and by means of several hacks managed to receive boot charts for OpenSolaris. First of all I need to get uptime values in bootchart format (this is /proc/uptime content on linux). I've written the small utility (upt.c):


#include <sys/times.h>
#include <limits.h>
#include <dat/dat_platform_specific.h>

main {
struct tms  ts;
clock_t t = times(&ts);
                                                          
//we need jiffies from uptime value for bootchart
printf("%u\n",(unsigned long) ((DAT_UINT64) t*100 /CLK_TCK));                                                                    
}

Now the main script for logging (/boot/bootchartd):


#!/usr/bin/bash                                                                                         
                                                                                                  
PATH="/sbin:/bin:/usr/sbin:/usr/bin:/usr/gnu/bin:$PATH"                                                 
                                                                                                  
# mounting dir for logging                                                                              
mount -F tmpfs -o size=32m swap /var/log/bootchart                                                                  
                                                                                                  
# start time hack for java parser                                                                       
echo "001" > /var/log/bootchart/ps.log                                                                  
echo "  PID  PPID S %CPU COMMAND" >> /var/log/bootchart/ps.log                                          
echo "    1     0 S  0.0 kernel" >> /var/log/bootchart/ps.log                                           
echo  >> /var/log/bootchart/ps.log                                                                      
                                                                                                  
while true; do                                                                                          
# uptime jiffies                                                                          
uptime=`/sbin/upt`                                                                                  
echo $uptime                                                                                        
# Log the command output and removing pid 0 for preventing "No processes found" error                                              
eval "ps -e -o pid,ppid,s,pcpu,comm"|grep -v sched                                                  
echo                                                                                                
/usr/gnu/bin/sleep 0.2                                                                              
done  >> /var/log/bootchart/ps.log

Let’s create directory /var/log/bootchart:


mkdir /var/log/bootchart

Next I move /sbin/init to /bin:


mv /sbin/init /bin

and create a new init:


cat /sbin/init

#!/bin/sh

/boot/bootchartd &
exec /bin/init

Now it's possible to reboot. After booting I write a header file:


echo "title = Boot chart for $( hostname | sed q ) ($( date ))" > /var/log/bootchart/header             
echo "system.uname = $( uname -srvm | sed q )" >> /var/log/bootchart/header                             
if [ -f /etc/release ]; then                                                                            
echo "system.release = $( sed q /etc/release )" >> /var/log/bootchart/header                        
else                                                                                                    
echo "system.release = $( sed 's/\\.//g;q' /etc/issue )" >> /var/log/bootchart/header               
fi

and create boot chart:


java -jar bootchart.jar

Parsing /var/log/bootchart
Wrote image: ./bootchart.png

This was the first boot chart created for OpenSolaris 2008.11 (Intel CPU 2.26GHz 512mb RAM). No disk and cpu utilization information yet:

Here the boot chart for snv101:

Installing pkg without pkg

2008-12-22T22:03:00.000-08:00

Unfortunately I can't install some IPS packages without dependences. Christopher Bergström has written a small shell script for sunstudio installation. Some time I've tested it and have created the ruby version for installation of any package. This script does not process "driver" tag in manifest but in the rest is suitable for installation and a bit more exact than shell script. You can view the source code (getpkg.rb) here.
Sample usage (I want to install SUNWipkg to /opt/ipkg):


# getpkg inst_dir manifest_url 
getpkg.rb /opt/ipkg http://pkg.opensolaris.org/release/manifest/0/SUNWipkg%400.5.11%2C5.11-0.101%3A20081104T032047Z

Preparing small miniroot with zfs and ssh

2008-12-15T06:23:00.000-08:00

This is instructions for building smallest OpenSolaris miniroot (standalone RAM) with ssh and zfs.
I use the receptions familiar to funs of minimization according to Jim Connors's framework. But now we will use IPS for installation of packages and we should delete files of some packages manually ("--install" or "--uninstall --without-deps" not yet implemented in pkg).
Well, I'm running Solaris Express and will use "/opt/test" as working dir. Here are the packages for small miniroot (/opt/pkg.list):

SUNWcsd
SUNWcs
SUNWcakr
SUNWcar
SUNWckr
SUNWcnetr
SUNWcsl
SUNWesu
SUNWgss
SUNWgssc
SUNWkey
SUNWkvm
SUNWlibms
SUNWlibsasl
SUNWloc
SUNWlxml
SUNWnfsc
SUNWnfsckr
SUNWopenssl
SUNWos86r
SUNWpr
SUNWpsdcr
SUNWpsdir
SUNWrmodr
SUNWbip
SUNWsmapi
SUNWssh
SUNWsshcu
SUNWsshd
SUNWtecla
SUNWtls
SUNWtoo
SUNWusb
SUNWusbs
SUNWzfs
SUNWzfskr
SUNWzlib
SUNWzone
SUNWbash
SUNWrtls

As you can see, I have Realteck network adapter (SUNWrtls). Let's go:


# working dir
export ROOTDIR=/opt/test

# create the packaging db (pkg already installed on Nevada)
/usr/bin/pkg image-create -F -a opensolaris.org=http://pkg.opensolaris.org ${ROOTDIR}

cd ${ROOTDIR}
for pkg in `cat ../pkg.list`; do
/usr/bin/pkg install ${pkg}
done

But after that we have some additional packages because of dependences. Now we need to remove these unneeded packages (/opt/rm.txt) :


SUNWaudd
SUNWgccruntime
SUNWinstall-libs
SUNWmd
SUNWpicl
SUNWpool
SUNWwbsup

I cannot delete some packages and will use "pkg contents" command:


for pkg in `cat ../rm.txt`; do
pkg contents -m $pkg|grep file|sed -e 's/.*path=//; s/pkg.csize.*//'|\
awk '{print "./"$1}';
pkg contents -m $pkg|grep link|sed -e 's/.*path=//; s/target.*//'|\
awk '{print "./"$1}';
done > files.tmp

We need "libmeta.so" library for devfsadm:


cat files.tmp|sed 's/.*libmeta.*//g' > files.list

Now I delete packages files:


for file in `cat ../files.list `; do rm -rf $file; done

Basic miniroot configuration:


cd ${ROOTDIR}

# Copy usr/sfw/lib/libwrap.so.1 to usr/lib
cp ${ROOTDIR}/lib/svc/seed/global.db ${ROOTDIR}/etc/svc/repository.db

rm ${ROOTDIR}/usr/lib/libcrypto.so*
cp ${ROOTDIR}/usr/sfw/lib/libcrypto.so.0.9.8 ${ROOTDIR}/usr/lib


# Fix etc/vfstab
echo "/devices/ramdisk:a - / ufs - no nologging" >> ${ROOTDIR}/etc/vfstab

# Set the timezone
echo "TZ=US/Eastern" > ${ROOTDIR}/etc/TIMEZONE

# Set hostname
echo "small" > ${ROOTDIR}/etc/nodename

# Create /etc/inet/hosts and /etc/inet/ipnodes file
echo "127.0.0.1 localhost loghost" > ${ROOTDIR}/etc/inet/hosts
echo "192.168.1.1 small" >> ${ROOTDIR}/etc/inet/hosts
echo "::1 localhost loghost" > ${ROOTDIR}/etc/inet/ipnodes
echo "127.0.0.1 localhost loghost" >> ${ROOTDIR}/etc/inet/ipnodes
echo "192.168.1.1 small" >> ${ROOTDIR}/etc/inet/ipnodes

# Set nsswitch.conf
cp ${ROOTDIR}/etc/nsswitch.files ${ROOTDIR}/etc/nsswitch.conf

# Set IP Address
echo "small" > ${ROOTDIR}/etc/hostname.rtls0

# Set up default route
echo "192.168.1.200" > ${ROOTDIR}/etc/defaultrouter

# Set the environment variables for svccfg.
SVCCFG_DTD=${ROOTDIR}/usr/share/lib/xml/dtd/service_bundle.dtd.1
SVCCFG_REPOSITORY=${ROOTDIR}/etc/svc/repository.db
SVCCFG=/usr/sbin/svccfg

export SVCCFG_DTD SVCCFG_REPOSITORY SVCCFG

${SVCCFG} import ${ROOTDIR}/var/svc/manifest/milestone/sysconfig.xml

# turnoff boot-archive, manifest-import
${SVCCFG} -s system/boot-archive setprop start/exec=:true
${SVCCFG} -s system/manifest-import setprop start/exec=:true
${SVCCFG} -s network/rpc/bind delpg sysidtool
${SVCCFG} -s system/metainit:default setprop general/enabled=false

# Here's what needed to add ssh
${SVCCFG} import ${ROOTDIR}/var/svc/manifest/system/cryptosvc.xml
${SVCCFG} -s system/cryptosvc:default setprop general/enabled=true

${SVCCFG} import ${ROOTDIR}/var/svc/manifest/network/inetd.xml
${SVCCFG} -s network/inetd:default setprop general/enabled=true

${SVCCFG} import ${ROOTDIR}/var/svc/manifest/network/rpc/gss.xml
${SVCCFG} -s network/rpc/gss:default setprop general/enabled=true

${SVCCFG} import ${ROOTDIR}/var/svc/manifest/network/ssh.xml
${SVCCFG} -s network/ssh:default setprop general/enabled=true

# Creating RSA/DSA keys for ssh
/usr/bin/ssh-keygen -q -f ${ROOTDIR}/etc/ssh/ssh_host_rsa_key -t rsa -N ''
/usr/bin/ssh-keygen -q -f ${ROOTDIR}/etc/ssh/ssh_host_dsa_key -t dsa -N ''

# Edit etc/ssh/sshd_config to allow ssh to root account
ex -s ${ROOTDIR}/etc/ssh/sshd_config > /dev/null <<> /dev/null

# Remove packaging, xpg4, sfw - you can remove more but be carefully
rm -rf var/sadm/* var/pkg/*
rm -rf usr/xpg4 usr/sfw

Now I prepare a miniroot image:


# we need freespace ~10mb
size=`/usr/bin/du -ks ${ROOTDIR}|/usr/bin/nawk '{print $1+10240}'`

/usr/sbin/mkfile ${size}k /opt/miniroot
lofidev=`/usr/sbin/lofiadm -a /opt/miniroot`

# get the miniroot raw device and create a filesystem on it
rlofidev=`echo $lofidev |sed s/lofi/rlofi/`
/usr/sbin/newfs -m 0 $rlofidev

# mount ufs filesystem
/usr/sbin/mount -o nologging $lofidev /mnt

/usr/bin/find .  /usr/bin/cpio -pdum /mnt
/usr/sbin/umount /mnt

/usr/sbin/lofiadm -d /opt/miniroot
/usr/bin/7za a -tgzip -mx=9 /opt/miniroot.gz /opt/miniroot

Done. Now I have a small OpenSolaris 2008.11 miniroot with ZFS and SSH (32601K gzipped - I've also removed a number of unnecessary binaries from SUNWcs). It's possible to make an image even less.

Creating 90mb LiveCD using Distribution Constructor

2008-12-11T06:02:00.000-08:00

Continuing a theme, it's possible to create a 90mb iso (minimal working LiveCD without Gnome and X) using the Distribution Constructor - command-line tool for building preconfigured, bootable OpenSolaris images. In the OpenSolaris 2008.11 release, this tool takes an XML manifest file as input, and builds an ISO image that is based on the parameters specified in the manifest file. I'm running Solaris Express and will use old-format configuration file.
I have added additional packages (SUNWgzip, SUNWgrub, SUNWslim-utils) in my short list (see post of December 08). Note: I need only "rtls" driver for this test so you should add packages for your network adapters. Besides, I use checkpoints as it will be necessary to change a script "/lib/svc/method/live-fs-root".
I have downloaded Distribution Constructor kit:


# hg clone ssh://anon@hg.opensolaris.org/hg/caiman/distro_constructor

I only have changed the list of packages and use my own checkpoint in "build_dist.bash":


# ./build_dist.bash small.conf

After installation of packages I have a pause (thanks to checkpoint). Now it's necessary to remove string "/usr/sbin/set_lang" in "/lib/svc/method/live-fs-root" and set "system/coreadm enabled=false" in generic_live.xml (otherwise there will be an errors after booting). It's only first test, you can change more. Then I finish creating the image. In DC output there will be some errors - the majority of them concerns Gnome which is not present.
I boot LiveCD in virtual machine - at first sight it works perfectly .
The test is fulfilled: for my list of packages the final iso has the size 90mb (but you can add any packages which are necessary for you).

OpenSolaris: life without Gnome

2008-12-09T01:04:00.000-08:00

I have console OpenSolaris installed (see my post of December 08). But I have forgotten to install the most valuable package:


pkg install SUNWzfs-auto-snapshot

Now I can install X:


pkg install SUNWxorg-server
pkg install SUNWxorg-xsvc
pkg install SUNWxorg-agp
pkg install SUNWxorg-graphics-ddx
pkg install SUNWxorg-client-programs
pkg install SUNWxwfsw
pkg install SUNWxwopt
pkg install FSWxorg-fonts

After installation I run "xinit" and get xterm. However it would be better to install some minimalistic window manager, for example, dwm.


pkg install SUNWwget
wget http://code.suckless.org/dl/dwm/dwm-5.3.1.tar.gz

Gcc,binutils,gmake and headers are required:


pkg install SUNWxorg-headers
pkg install SUNWgmake
pkg install SUNWbinutils
pkg install SUNWgcc

I love vim. Also I need gzip:


pkg install SUNWvim
pkg install SUNWgzip

If you plan to compile some other apps, I advice to install substudio:


pkg install sunstudioexpress

Next I unpack archive, correct config.h and compile dwm. It's possible to start dwm xsession from smf. You can look how it's made in BeleniX or MilaX.

As a result I got system with short boot time and an easy and fast window manager.
At the end I need usual user:


mkdir /home
useradd -d /home/me -m -s /bin/ksh -c "System Developer" me
passwd me

Minimal OpenSolaris 2008.11 Install

2008-12-08T03:15:00.000-08:00

Using instructions from Edward Pilatowicz' blog I got small working OpenSolaris 2008.11 in the console version: without Xorg (and Gnome of course).
First of all the list of the core packages for normal work in the console is necessary. My computer has Realtek ethernet adapter and I also have added a SUNWrtls package. Here's example list (pkg.txt):


SUNWcsd
SUNWcs
SUNWzone
SUNWcsl
SUNWlibsasl
SUNWlibms
SUNWpr
SUNWlxml
SUNWzlib
SUNWtls
SUNWopenssl
SUNWpool
SUNWzfs
SUNWsmapi
SUNWtecla
SUNWckr
SUNWpicl
SUNWmd
SUNWinstall-libs
SUNWwbsup
SUNWgccruntime
SUNWcar
SUNWcakr
SUNWusbs
SUNWusb
SUNWaudd
SUNWkvm
SUNWos86r
SUNWrmodr
SUNWpsdcr
SUNWpsdir
SUNWcnetr
SUNWesu
SUNWkey
SUNWnfsckr
SUNWnfsc
SUNWgss
SUNWgssc
SUNWbip
SUNWbash
SUNWloc
SUNWsshcu
SUNWsshd
SUNWssh
SUNWtoo
SUNWzfskr
SUNWipf
SUNWrtls
SUNWipkg
SUNWpython-pyopenssl
SUNWpython-cherrypy
SUNWadmr
SUNWadmap
SUNWadmlib-sysid
SUNWPython
SUNWbzip
SUNWxwrtl
SUNWTk
SUNWTcl
SUNWlexpt
SUNWperl584core

As last versions of packages have dependences, for example SUNWcs is installing SUNWgccruntime, SUNWPython is installing packages SUNWTk and SUNWTcl. But finally I got installed system with size about 280 mb - it's a smaller than 3 Gb;)
I use the same commands as in Edward's blog (I'm running Solaris Express):


zpool create -f rpool c1t1d0s0
zfs set compression=on rpool
zfs create -p rpool/ROOT/indy/opt
zfs set canmount=noauto rpool/ROOT/indy
zfs set canmount=noauto rpool/ROOT/indy/opt
zfs set mountpoint=legacy rpool/ROOT/indy
zfs set mountpoint=legacy rpool/ROOT/indy/opt

# we're going to do our install in /a
PKG_IMAGE=/a; export PKG_IMAGE

# mount our zpool on /a
mkdir -p $PKG_IMAGE
mount -F zfs rpool/ROOT/indy $PKG_IMAGE
mkdir -p $PKG_IMAGE/opt
mount -F zfs rpool/ROOT/indy/opt $PKG_IMAGE/opt

For Solaris Express you must install pkg (not required if you're booting from OpenSolaris or MilaX LiveCD):


hg clone ssh://anon@hg.opensolaris.org/hg/pkg/gate
cd gate/src
make install

# create the basic opensolaris install image..
pkg image-create -F -a opensolaris.org=http://pkg.opensolaris.org $PKG_IMAGE
pkg refresh

Note: I use here list of basic packages - pkg.txt (see above):


for pkg in `cat pkg.txt`; do pkg install $pkg; done


# seed the initial smf repository
cp $PKG_IMAGE/lib/svc/seed/global.db $PKG_IMAGE/etc/svc/repository.db
chmod 0600 $PKG_IMAGE/etc/svc/repository.db
chown root:sys $PKG_IMAGE/etc/svc/repository.db

# setup smf profiles
ln -s ns_files.xml $PKG_IMAGE/var/svc/profile/name_service.xml
ln -s generic_limited_net.xml $PKG_IMAGE/var/svc/profile/generic.xml
ln -s inetd_generic.xml $PKG_IMAGE/var/svc/profile/inetd_services.xml
ln -s platform_none.xml $PKG_IMAGE/var/svc/profile/platform.xml

# mark the new system image as uninstalled
sysidconfig -b $PKG_IMAGE -a /lib/svc/method/sshd
touch $PKG_IMAGE/etc/.UNCONFIGURED

# configure our new /etc/vfstab
printf "rpool/ROOT/indy -\t/\t\tzfs\t-\tno\t-\n" >> $PKG_IMAGE/etc/vfstab
chmod a+r $PKG_IMAGE/etc/vfstab

# turn off root as a role
printf "/^root::::type=role;\ns/^root::::type=role;/root::::/\nw" |\
ed -s $PKG_IMAGE/etc/user_attr

# delete the "jack" user
printf "/^jack:/d\nw" | ed -s $PKG_IMAGE/etc/passwd
chmod u+w $PKG_IMAGE/etc/shadow
printf "/^jack:/d\nw" | ed -s $PKG_IMAGE/etc/shadow
chmod u-w $PKG_IMAGE/etc/shadow

# copy of my existing host sshd keys
cp -p /etc/ssh/*key* $PKG_IMAGE/etc/ssh

# configure /dev in the new image
devfsadm -r $PKG_IMAGE
ln -s ../devices/pseudo/sysmsg@0:msglog $PKG_IMAGE/dev/msglog

# update the boot archive in the new image
bootadm update-archive -R $PKG_IMAGE

# update to the latest version of grub (this command generated
# some errors which i ignored).
$PKG_IMAGE/boot/solaris/bin/update_grub -R $PKG_IMAGE

# create an informational grub menu in the install image that
# points us to the real grub menu.
cat <<-EOF > $PKG_IMAGE/boot/grub/menu.lst

#########################################################################
#                                                                       #
# For zfs root, menu.lst has moved to /rpool/boot/grub/menu.lst.        #
#                                                                       #
#########################################################################
EOF

# create the new real grub menu
cat <<-EOF > /rpool/boot/grub/menu.lst
default 0
timeout 10
splashimage /boot/grub/splash.xpm.gz

title Solaris 2008.11 console
findroot (pool_rpool,0,a)
bootfs rpool/ROOT/indy
kernel\$ /platform/i86pc/kernel/\$ISADIR/unix -k -B \$ZFS-BOOTFS,console=ttya
module\$ /platform/i86pc/\$ISADIR/boot_archive

EOF

# make the grub menu files readable by everyone.
chmod a+r $PKG_IMAGE/boot/grub/menu.lst
chmod a+r /rpool/boot/grub/menu.lst

# setup /etc/bootsign so that grub can find this zpool
mkdir -p /rpool/etc
echo pool_rpool > /rpool/etc/bootsign

umount $PKG_IMAGE/opt
umount $PKG_IMAGE
reboot

After reboot you get the console version of OpenSolaris with which you can do all that you want. Next you can install only those packages which are necessary for you. For example it's useful to owners of old notebooks. This installation can be made from an OpenSolaris LiveCD in text mode or with help of a MilaX LiveCD (where's ipkg is included).