Learning the Terminal in Jaguar, Part 3
Pages: 1, 2
Restoring your database from this file requires a bit of work, but the dozen or so steps needed would certainly be worth the time if you really had to restore all of you NetInfo data. You can find a good description of these steps (which I've tested to work with Mac OS X 10.2.4) here.
The heading of the next section of the script is, as you can see in the
cron report, "Checking subsystem status."
Checking subsystem status:
disks:
Filesystem 1K-blocks Used Avail Capacity Mounted on
/dev/disk0s5 40016844 33274772 6742072 83% /
fdesc 1 1 0 100% /dev
/dev/disk2s1s2 354552 354552 0 100% /Volumes/Q3TA
This output is a result of the df -k -l command in the
daily script, which reports the used and free space on all local
disks. This example shows a 40-gigabyte system disk (which will always
show as "mounted on" /, or "root") with about 6.7 gigabytes
of free space.
You can ignore the fdesc line, which doesn't refer to any
actual disk, but to part of the filesystem plumbing.
Any other local volumes you have mounted will also show up in this
list. This example shows a disk (in fact, a CD-ROM) mounted on
/Volumes/Q3TA. This attribute, known as the disk's "mount
point," shows you the path you would take to reach that disk via the
CLI. For example, to peek inside the Q3TA CD you would enter ls
/Volumes/Q3TA.
You will find all local disks and most network volumes mounted within
/Volumes.
The next relevant command simply checks sendmail's queue
for any undeliverable messages. If the report doesn't show this directory
as empty (and the procedure in this tutorial is your only use of
sendmail), then it's likely you have some
sendmail issue.
The 500.daily script then runs the netstat -i
command, which outputs the network statistics to the report, a few lines
of which might look something like this:
network: Name Mtu Network Address Ipkts Ierrs Opkts Oerrs Coll lo0 16384 <Link#1> 15528 0 15528 0 0 lo0 16384 localhost ::1 15528 - 15528 - - lo0 16384 fe80:1::1 fe80:1::1 15528 - 15528 - - lo0 16384 127 localhost 15528 - 15528 - - gif0* 1280 <Link#2> 0 0 0 0 0 stf0* 1280 <Link#3> 0 0 0 0 0 en0 1500 <Link#4> 00:03:93:bd:c9:2c 160141 545668 54718 0 0 en0 1500 fe80:4::203 fe80:4::203:93bb: 160141 - 54718 - - en0 1500 172.24 dhcp-172-24-31- 160141 - 54718 - - en0 1500 (16)00:00:00:67:24 160141 545668 54718 0 0 en1 1500 <Link#5> 00:30:bd:09:4b:bd 7723 0 2489 0 0 en1 1500 fe80:5::230 fe55:5::230:65ff: 7723 - 2489 - - en1 1500 172.18 172.18.1.21 7723 - 2489 - - ppp0 1466 <Link#6> 0 0 0 0 0 ppp0 1466 172.24 dhcp-172-24-40- 0 - 0 - -
The netstat -i command lists your network interfaces in
rows, showing traffic statistics for each (since activation) in the
columns. This example actually shows just two hardware interfaces:
en1 is an Airport card, and en0 is the Ethernet
port. The ppp0 interface shown is one that in use by the PPTP VPN
client.
You will see some other lines for the IP interfaces, including the
"local loop" interface (lo0), and a couple more related to
IPv6 networking (stf0 and gif0). At this point,
you'll be fine to only focus on the lines for showing "<link>" in
the network column. The other pertinent columns are the actual
packet-count columns:
Ipkts -- Incoming packets
Ierrs -- Incoming packet errors
Opkts -- Outgoing packets
Oerrs -- Outgoing packet errors
Coll -- Packet collisions
What you should be concerned with, of course, are any non-zero entries in the error or collision columns. I won't go into troubleshooting your network here, but this page might be a good place to start if something does turn up: http://www.princeton.edu/~unix/Solaris/troubleshoot/netstat.html.
The next important job of the 500.daily script is the
rotation of the system log. This log file, system.log,
records the status and error messages from the large number of processes
that comprise the OS.
In the case where no backups of system.log yet exist, the
script makes the first backup, compresses it using gzip, and
numbers it 0. This results in a file called
system.log.0.gz. By "rotating" this log file on subsequent
days, the script will first rename system.log.0.gz to
system.log.1.gz, and then create a new
system.log.0.gz.
Each day, the script creates a new system.log.0.gz file
after incrementing the other backup filenames by one. Once
system.log.7.gz is created, however, there will be no ninth
backup file. Instead, on the subsequent backup the
system.log.6.gz file (renamed to
system.log.7.gz) just overwrites the previous
system.log.7.gz file.
This procedure, then, ensures that you'll have over a week's worth of logs to refer to in case problems arise, but not so many as to waste disk space, and likely none too large to not view easily.
Next, the script "cleans" the web server log files by deleting any rotated files that have been around longer than a week.
The Weekly Script
As you saw in the /etc/crontab file, cron
also calls on periodic each week to look in the
/periodic/weekly directory for scripts to run, and the script
it will find there is named 500.weekly.
The 500.weekly script performs three important tasks, none
of which provides any output to the report except a statement that the
command was performed (unless there are any errors to report).
Locate
One of the most useful Unix command line utilities is
locate, a lightning-fast file finder. locate
does its magic by searching through a database of filenames created by
indexing every pathname on your system. Instead of scanning your disks to
find a file, locate just whips through its pre-indexed
database, and returns results almost immediately.
However, locate results are only as accurate as its
database. Files added after the database has been built will not be
"located." locate is not the tool for every search, but with
weekly database rebuilding, it's great for quickly finding that long-lost
file you know is tucked away somewhere on your drive. The first task of
the weekly script, then, is to rebuild the locate
database.
If you are antsy to try locate for yourself, have a look
at the short locate tutorial included in the article found here.
The weekly script updates another important database used by the
whatis command. whatis is a nifty little memory
jogger that quickly shows you the function of a given command, like
this:
[localhost:~] chris% whatis netstat
netstat(1) - show network status
What whatis displays is, in fact, the first line of a
command's "man page". If you're not already familiar with man
pages, you should be. These comprise the massive collection of online Unix
documentation included with Mac OS X. Look here for a great
tutorial on using man pages.
The weekly script, then, creates a whatis database from
all man pages it finds, allowing whatis to
return an answer faster than you can say, "Duh!"
Last, the weekly script also rotates several other log files, including
those for ftp and netinfo.
The Monthly Script
As you also saw in the /etc/crontab file,
cron calls on periodic each month to run any
script found in the /periodic/monthly directory, which you
can see is a script named 500.monthly.
There's actually very little to the monthly script, but what it does
provide can be pretty interesting, if you like to know where all your time
goes. The monthly script's first task is to run the "connect time
accounting" utility ac. ("Connect" here means "logged
in.")
When run from the monthly script, ac will report the
cumulative time, in hours, each user account has been logged in since the
last time the script ran, as well as the total for all users:
Doing login accounting:
total 714.22
chris 548.76
miho 101.77
andy 54.39
jonny 9.18
test1 0.06
ftp 0.06
ac calculates these totals by reading the current
wtmp log file, which logs every login and logout. You can
view this list anytime with the last command:
[localhost:/var/log] chris% last
chris ttyp2 Thu Feb 21 16:18 still logged in
chris ttyp1 Thu Feb 21 16:16 still logged in
chris console localhost Thu Feb 21 16:02 still logged in
reboot ~ Thu Feb 21 16:01
So how does ac know to restart the accounting each month?
Well, right after ac reports its findings, the monthly script
rotates the wtmp logs, creating a new empty wtmp
file to start logging to. The next time the monthly script runs, then,
ac will do its accounting based on this new file.
Final Thoughts
You should now have a good idea of what the three cron
jobs do and what to look for in the reports. If you're still having
problems with anything, make sure to look at the TalkBack sections for all
parts of this tutorial, where readers and I have covered most of the
common problems and made some corrections.
Also, if you would like to learn lots more about cron,
here's another
tutorial for you.
Now that your feet (or even your knees) are wet working with Terminal and Unix, you have an entire ocean left to explore. I hope this tutorial has given you the confidence to dive in. There are other articles here on the Mac DevCenter you should now be ready for, as well as plenty more around the Internet.
Chris Stone is a Senior Macintosh Systems Administrator for O'Reilly, coauthor of Mac OS X in a Nutshell and contributing author to Mac OS X: The Missing Manual, which provides over 40 pages about the Mac OS X Terminal.
Read more Learning the Mac OS X Terminal columns.
Return to the Mac DevCenter.
You must be logged in to the O'Reilly Network to post a talkback.
Showing messages 1 through 8 of 8.
-
my mind is now mush
2003-05-19 12:49:35 anonymous2 [Reply | View]
I went to sleep last night and woke up with some understanding from the other parts. I did get a little lost on the part 3. Maybe when I walk through changing the cron file, etc on my other G3 it will sink in. Thank you!
-
cool
2003-04-10 15:34:07 anonymous2 [Reply | View]
Now how about an article on writing shell scripts? Then we could really decipher the periodics, as well as write our own.
-
good article but where are the shutdown scripts
2003-03-31 08:54:49 mpobrien [Reply | View]
Good tutorial on the workings of the cron and ac but I am at a loss to get some sort of graceful shutdown ! Can you offer any guidance ?
thanks
-
Thanks - and a question!
2003-03-30 03:41:30 macmartin [Reply | View]
Thanks for the third part of this excellent article, which helped me a lot to get into the Terminal.
I think there is a little mistake in the section about the weekly script.
Isnīt name of the script 500.weekly</> instead of 500.daily?
There are some questions left about sendmail:
In the /var/log/mail.log I get this output at boot time and every time sendmail is started manually.
Mar 30 11:12:31 saturn sendmail[411]: File descriptors missing on startup: stdin, stdout, stderr; Bad file descriptor
Mar 30 11:12:31 saturn sendmail[411]: gethostbyaddr(192.168.100.10) failed: 3
Mar 30 11:12:31 saturn sendmail[412]: starting daemon (8.12.7): SMTP+queueing@01:00:00
Mar 30 11:12:31 saturn sendmail[414]: File descriptors missing on startup: stdin, stdout, stderr; Bad file descriptor
Mar 30 11:12:31 saturn sendmail[415]: starting daemon (8.12.7): queueing@01:00:00
The "File descriptors missing on startup: stdin, stdout, stderr; Bad file descriptor" problem is asked by hundreds of (BSD- and Linux-) users across the internet.
I have read that this error is somehow related to the cron utility, but I couldnīt find a solution yet.
Question 1: What causes this error output?
How can the "Bad file descriptor get fixed?
The "gethostbyaddr(192.168.100.10) failed: 3 only shows up, when Iīm connected to a local Network via NIC.
Question 2: I guess this is because I have not configured DNS yet.
Is that right ?
Is there a trick to fix this similar to the DontBlamSendmail-thing ?
Where can I find a tutorial to set up DNS via Command Line?
Any help would be appreciated gladly.
Thanks again
.
-
On the topic of the terminal...
2003-03-21 17:06:35 brianimator [Reply | View]
Perhaps you can help a rookie out:
When entering a line such as:
cd /usr/local/mysql
the last "l" in "local" and the "/" that follow it merge into a weird symbol (like an l with a slash through it) This happened after installing Fink - and altering the ~.tcsch file... any suggestions?






I was a windows user but moved to Mac OS X. I have some perl scripts I run on MS-DOS cmd.exe but have been having problems running those scripts on Mac OS X terminal.
Is there any command used for running perl scripts or how do I go about it.
Thanks for responding.
Cruzapete