Compile error with TLS and Openssl

[warrenliang]

Hello:
I try to implement TLS function into the sendmail v8.12. Installed the binary version of Openssl v0.9.7e (pagadd) first, and then modified site.config.m4 file to include TLS and OpenSSL. However, many errors occur during “# ./Build -c”. Any recommendation is welcomed.

Sendmail's version:
Version 8.12.10
Compiled with: DNSMAP LOG MAP_REGEX MATCHGECOS MILTER MIME7TO8 MIME8TO7 NAMED_BIND NDBM NETINET NETINET6 NETUNIX NIS NISPLUS PIPELINING SCANF XDEBUG
============ SYSTEM IDENTITY (after readcf) ============
(short domain name) $w = g4
(canonical domain name) $j = g4.corp.com
(subdomain name) $m = corp.com
(node name) $k = g4

Package Openssl's information:
PKGINST: SMCossl
NAME: openssl
ARCH: sparc
VERSION: 0.9.7e
BASEDIR: /usr/local/ssl

Host: Solaris V8. Generic_117000-03

Content of file /usr/share/src/sendmail-8.12.10/devtools/Site/site.config.m4 :
APPENDDEF(`conf_sendmail_ENVDEF', `-DMILTER')
APPENDDEF(`conf_libmilter_ENVDEF', `-D_FFR_MILTER_ROOT_UNSAFE')
APPENDDEF(`conf_sendmail_ENVDEF', `-DSTARTTLS')
APPENDDEF(`conf_sendmail_LIBS', `-lssl -lcrypto')
APPENDDEF(`conf_sendmail_INCDIRS', `-I/usr/local/ssl/include')
APPENDDEF(`conf_sendmail_LIBDIRS', `-L/usr/local/ssl/lib')

I cd to /usr/share/src/sendmail-8.12.10 and execute the Build command:
/usr/share/src/sendmail-8.12.10# ./Build -c
...
ar: writing libsmutil.a
ar: writing libsmdb.a
In file included from main.c:15:
sendmail.h:120:27: openssl/ssl.h: No such file or directory
In file included from alias.c:14:
sendmail.h:120:27: openssl/ssl.h: No such file or directory
...
In file included from util.c:14:
sendmail.h:120:27: openssl/ssl.h: No such file or directory
make[1]: *** [depend] Error 1
In file included from main.c:15:
sendmail.h:120:27: openssl/ssl.h: No such file or directory
In file included from main.c:15:
sendmail.h:674: parse error before "SSL"
sendmail.h:674: warning: no semicolon at end of struct or union
sendmail.h:677: parse error before '}' token
sendmail.h:1381: field `sv_mci' has incomplete type
sendmail.h:1825: parse error before '*' token
sendmail.h:1829: parse error before '*' token
sendmail.h:1830: parse error before '*' token
make[1]: *** [main.o] Error 1
#
All those *.h files are in the directory:
/usr/local/ssl/include/openssl# ls
aes.h es_old.h krb5_asn.h pem2.h ssl3.h asn1.h dh.h kssl.h pkcs12.h stack.h asn1_mac.h dsa.h lhash.h pkcs7.h symhacks.h asn1t.h dso.h md2.h rand.h tls1.h
bio.h e_os2.h md4.h c2.h tmdiff.h
blowfish.h ebcdic.h md5.h rc4.h txt_db.h
bn.h ec.h mdc2.h rc5.h ui.h
buffer.h engine.h obj_mac.h ripemd.h ui_compat.h
cast.h err.h objects.h rsa.h x509.h
comp.h evp.h ocsp.h safestack.h x509_vfy.h
conf.h fips.h opensslconf.h sha.h x509v3.h
conf_api.h fips_rand.h opensslv.h ssl.h
crypto.h hmac.h ossl_typ.h ssl2.h
des.h idea.h pem.h ssl23.h

Thanks in advance.
Warren

 

[warrenliang]

I added /usr/local/ssl/lib into LD_LIBRARY_PATH and /usr/local/ssl in PATH. Build works.
I move into configuration phase.
Warren